
Azure Data Engineer
WinWire Technologies · Aug 2025 – Present
- Design, develop, and maintain secure, scalable Spark-based data pipelines in Azure Databricks (PySpark) with Auto Loader and DLT for schema-on-read ingestion of structured, semi-structured, and unstructured data, supporting both batch and streaming workloads.
- Architect end-to-end ETL/ELT orchestration workflows in Azure Data Factory Linked Services, trigger-based scheduling, and reusable parameterized pipelines - moving data from legacy and on-premises systems (SAP HANA, Veeva CRM, RDBMS) into a modern Azure cloud data lake environment via a metadata-driven ingestion framework.
- Establish Medallion Architecture (Bronze/Silver/Gold) on Microsoft Fabric Lakehouse using Delta Lake, enforcing schema and row-level data quality validation, and troubleshooting pipeline performance bottlenecks at each layer across the full development lifecycle.
- Perform cloud engineering and administration tasks spanning infrastructure, security, and access management; evaluate emerging data engineering trends and enterprise-approved Al tools (GitHub Copilot) to streamline coding, unit testing, and technical documentation.
- Gained hands-on exposure to Azure Event Hub and Azure Stream Analytics for event-driven ingestion patterns and Azure Functions for lightweight serverless processing, supplementing core Databricks/ADF pipeline work.


