Azure Developer
Cognizant Pvt Ltd · Jul 2019 – Present
- Participate in Business meetings, scrum calls to understand the customer requirement to migrate from Synapse to Azure Data Bricks.
- Worked as an Azure Data Engineer/Databricks Developer on migration of data objects from Azure Synapse to Azure Databricks.
- Migrated stored procedures, views, and tables from Azure Synapse to Databricks notebooks and Delta tables across silver and gold layers.
- Developed and optimized SQL/PySpark logic in Azure Databricks notebooks to replicate existing business logic and data transformations.
- Performed source-to-target data validation to ensure data accuracy, completeness, and consistency after migration.
- Created and maintained unit testing documents and test scenarios covering data validation, transformation logic, and expected results.
- Investigated and fixed defects raised by the product owner through Azure DevOps Boards.
- Performed root-cause analysis for data mismatches and migration issues and implemented appropriate fixes in Databricks.
- Participated in Scrum calls together with developers, Project managers, Product owners to understand and estimate the story points of the User Stories.
- Collaborated with stakeholders to gather functional requirements, analysed data challenges, and escalate critical issues to business leadership for resolution.
- Participated in the data movement from delta lake silver layer to core tables in Synapse with Staging as Azure data lake Storage.
- Writing Implementation notebook and Creation notebook for each Facts and Dimension models upon Silver Layer 2.
- Partnered with BI reporting teams to provide curated datasets tailored to analytics requirements, enabling insightful decision-making.
- Create Views on Gold delta tables which are consumed by Power Bi reports.
- Built end-to-end data pipelinesin Azure Data factory for Orchestrate the data movement using various control flow activities like Linked services, Copy Activity, Look Up, For Each, Execute Pipeline.
- Create Logic Apps to send an email notification in case of any failures in the pipelines.
- Leveraged tools like Azure DevOps to manage version control and implement continuous integration/continuous deployment (CI/CD) pipelines.
- Create Indexes and statistics to fine tune the performance.
- Extensively supported SIT and UAT, fixed the reported bugs.
- Involved in Business meetings to determine project scope, tasks and understand the customer requirement.
- Migrated objects from Teradata to Azure synapse.
- Inherited the TD foundation scripts into views and stored procedures.
- Performed unit testing and data validation.
- Go Live and postproduction support.

