Data Engineer
Bitwise Global Solutions · Nov 2022 – Present
- Developed and maintained Azure Data Factory (ADF) pipelines for post-migration data integration and reporting workloads.
- Worked with Medallion Architecture (Bronze, Silver and Gold layers) to organize curated data for downstream reporting.
- Used PySpark to read Delta and Parquet datasets for data validation, reconciliation and quality verification.
- Developed SQL Views, Stored Procedures and Azure Synapse SQL objects to support enterprise reporting and analytics requirements.
- Designed and maintained Fact and Dimension tables for enterprise reporting.
- Developed interactive Power BI dashboards, paginated reports and DAX measures based on business requirements.
- Performed source-to-target validation, reconciliation and business rule validation to ensure data accuracy before UAT and Production releases.
- Managed work items using Azure DevOps and collaborated in CI/CD deployment activities during release cycles.
- Supported SIT, UAT and Production issues by resolving incidents through Jira and ServiceNow while ensuring SLA compliance.
- Collaborated with business stakeholders to demonstrate sprint deliverables, validate reports and support production releases.
- Monitored scheduled pipeline executions, investigated pipeline failures and resolved production issues within SLA timelines.
- Contributed to the migration of enterprise data from on-premises SQL Server to the Azure cloud using Azure Data Factory (ADF) and Azure Databricks.
- Designed and developed Azure Data Factory pipelines using Linked Services, Datasets and parameterized pipeline activities.
- Built ETL workflows using Copy Activity, Lookup, Get Metadata, If Condition, Filter, Set Variable and ForEach activities.
- Ingested enterprise data from SQL Server into Azure Data Lake Storage Gen2 (ADLS Gen2) and Azure SQL Database for downstream processing.
- Worked with Azure Databricks notebooks to execute data transformation workflows and support cloud migration activities.
- Worked with Medallion Architecture (Bronze, Silver and Gold layers) to organize enterprise data across raw, curated and business-ready layers.
- Performed source-to-target validation, reconciliation and data quality checks after migration.
- Used PySpark to read Delta, Parquet and CSV datasets for data validation, reconciliation and migration verification.
- Applied basic Python scripts for data validation and troubleshooting activities.
- Worked with Delta Lake concepts to support incremental data loading and optimize data storage for analytics.
- Managed work items using Azure DevOps and collaborated in CI/CD deployment activities during release cycles.
- Collaborated with QA and business users during SIT, UAT and Production release activities.
- Monitored pipeline executions, investigated migration issues and resolved production incidents through Jira and ServiceNow within SLA timelines.


