
Data Engineer
OPTUM (United Health Group) · Sep 2023 – Present
- Designed, developed, and maintained 10+ enterprise ETL pipelines supporting daily and weekly batch processing, enabling seamless ingestion of structured and semi-structured data from on-premises and cloud sources.
- Modernized legacy data platforms by migrating Oracle to Snowflake and SQL Server (SSMS) to PySpark on Databricks, rebuilding ETL pipelines and scheduled jobs from scratch while implementing Azure Data Lake Storage Gen2 (ADLS Gen2) for scalable cloud storage.
- Engineered high-performance distributed data pipelines processing 230M+ records daily, reducing overall ETL execution time by 60% and completing end-to-end processing in under 1 hour.
- Developed optimized SQL transformation frameworks, including Slowly Changing Dimension (SCD) Type 2 implementation, reducing data transformation time by 50% while ensuring accurate historical data management.
- Accelerated software delivery by leveraging GitHub Copilot and Amazon Q(AIDLC) to modernize SQL workloads, generate PySpark code, automate documentation, and improve developer productivity.
- Ensured HIPAA and CMS compliance by implementing secure data governance practices for enterprise healthcare datasets containing PHI and PII.



