
Senior Data Engineer
Birlasoft Pvt Ltd · Aug 2021 – Present
- Managing and administering the Dataiku platform on AWS, ensuring stable performance and resolving production issues.
- Performing infrastructure migration by consolidating resources into a single VPC to improve monitoring and optimize costs.
- Building CI/CD pipelines using Jenkins to deploy projects from development to production environments.
- Upgrading Dataiku features and ensuring data quality through validation, monitoring, and testing processes.
- Migrating ETL workflows from KNIME to Dataiku using Python to improve efficiency and maintainability.
- Reengineering ETL workflows by identifying bottlenecks and optimizing performance.
- Setting up Grafana monitoring server to collect metrics and configure alerts for Dataiku EC2 instances.


