Data Engineer
Signify Health (a CVS Health company) · Jul 2024 – Present
- Sustained 99.5% uptime for near-real-time patient and operations visibility by architecting a multi-terabyte ELT pipeline in Azure Data Factory, Databricks, and Snowflake that curates clinical and claims data from Azure Data Lake into Synapse.
- Reduced validation errors and incidents by 40% by building a dbt transformation layer with automated reconciliation, referential-integrity, uniqueness, and dbt-expectations tests across Snowflake and Synapse models.
- Cut PySpark job latency by 25% on multi-terabyte healthcare datasets, while preserving accuracy and secure, HIPAA-aligned data governance, by applying partition pruning, broadcast joins, and adaptive query execution on Databricks.
- Lowered compute costs by 35% and enabled sub-15-minute refresh cycles for clinical dashboards by replacing full-table reloads with schema-evolving incremental ingestion using Delta Live Tables and Databricks Auto Loader.

