AWS Data Engineer
Accenture Solution Pvt. Ltd. · Nov 2025 – Present
- Designed and built scalable ETL pipelines using AWS services such as S3, Glue, and EMR to ingest and process data from multiple sources into cloud-based data lakes and warehouses.
- Automated and orchestrated data workflows using AWS services such as Step Functions, ensuring reliable and timely pipeline execution.
- Developed and optimized data transformation logic using AWS Glue (PySpark), improving processing performance and reducing latency.
- Implemented S3-based data lake architecture with lifecycle policies and archival strategies (Glacier) to optimize storage costs and data retention.
- Developed pipeline automation, monitoring, and reporting, including job health checks and resource utilization tracking.
- Collaborated with cross-functional teams to implement enhancements, resolve production issues, and support release deployments.
- Participated in disaster recovery (DR) and data change request (DCR) activities, ensuring data availability, integrity, and compliance.
- Enhanced observability by implementing monitoring and alerting using AWS CloudWatch, enabling proactive issue detection and performance tuning.
- Involved in designing, developing, and maintaining data processing pipelines for large-scale banking datasets using AWS services.
- The project focused on modernizing data workflows, improving performance, and ensuring high availability of critical ETL systems.

