
Software Engineer (Data Engineering)
Globestar Software Limited · Jul 2023 – Sep 2026
- Architected production data pipelines on Azure Databricks and Data Factory, processing 500K+ records/day using PySpark and Delta Lake to power downstream ML/analytics workloads.
- Optimized Spark and Synapse jobs via advanced partitioning and indexing, reducing execution time by 30% and streamlining CI/CD workflows across Dev/Prod using Azure DevOps.
- Engineered reusable, metadata-driven ADF pipelines (Lookup, ForEach, Metadata, Copy), accelerating secure onboarding of new datasets within Azure VNets and Bastion.

