
Software Engineer - 2
NetM Corp. · Jun 2025 – Present
- As a Software Engineer II, I design, develop, and maintain cloud-based ETL/ELT solutions on Microsoft Azure.
- My work focuses on building scalable data pipelines using Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage Gen2 (ADLS Gen2), Azure SQL Database, PySpark, and Delta Lake to support enterprise reporting and analytics.
- My responsibilities include developing parameterized Azure Data Factory pipelines, orchestrating data ingestion from multiple source systems, implementing PySpark transformation workflows, and building Delta Lake pipelines using the Medallion Architecture (Bronze, Silver, Gold).
- I also develop incremental data loading frameworks using Delta Lake MERGE operations and optimize Spark workloads through partitioning, caching, broadcast joins, OPTIMIZE, and ZORDER techniques.
- Additionally, I design and optimize Azure SQL database objects, perform source-to-target validation and reconciliation, support production data pipelines, troubleshoot pipeline failures, and collaborate with cross-functional teams to deliver reliable and maintainable enterprise data solutions.


