
Senior Data Engineer (Official: Integration Developer)
Five Below (via WowtownAI Technologies) · Sep 2024 – Present
- Engineered 50+ data pipelines following Medallion Architecture, processing 10M+ daily supply chain records, enabling upstream and downstream data integrations, orchestrating Databricks jobs using Airflow.
- Migrated 350+ DAGs from Airflow v2 to v3 on Astronomer Cloud, collaborating across engineering teams to ensure a zero-downtime production transition.
- Led the upgrade of 450+ Databricks notebooks, 100+ workflows to Databricks Runtime 15.4 LTS, including compute cluster upgrades, resolving library compatibility issues, and end-to-end regression testing.
- Executed Unity Catalog enablement in MOVE domain's workspace by collaborating with an external vendor to configure catalogs, schemas, and permissions, validating cluster and storage access, with zero-impact production cutover.
- Executed Blob to ADLS Gen2 migration by provisioning target storage, migrating datasets, configuring access permissions, updating storage references across Databricks notebooks, and validating data ingestion.
- Resolved 2,500+ SonarQube issues across multiple repos by introducing reusable utilities and standardized error handling, leveraging Cursor AI, reducing resolution time to one-fourth of the manual effort, achieving full compliance.
- Developed shell scripts for server-side automation, including system reboot orchestration and operational utility tasks, reducing manual intervention.



