sivaji koviri

As an Azure Data Engineer, I am driven by a determined ambition to master complex data challenges, leveraging my logical and insightful approach to architect robust, pragmatic solutions. My focus is always on achieving optimal outcomes through meticulous design and a commitment to continuous improvement.

Experience

W

Azure Data Engineer

WinWire Technologies · Aug 2025 – Present

Not yet confirmed

• Design, develop, and maintain secure, scalable Spark-based data pipelines in Azure Databricks (PySpark) with Auto Loader and DLT for schema-on-read ingestion of structured, semi-structured, and unstructured data, supporting both batch and streaming workloads.
• Architect end-to-end ETL/ELT orchestration workflows in Azure Data Factory Linked Services, trigger-based scheduling, and reusable parameterized pipelines - moving data from legacy and on-premises systems (SAP HANA, Veeva CRM, RDBMS) into a modern Azure cloud data lake environment via a metadata-driven ingestion framework.
• Establish Medallion Architecture (Bronze/Silver/Gold) on Microsoft Fabric Lakehouse using Delta Lake, enforcing schema and row-level data quality validation, and troubleshooting pipeline performance bottlenecks at each layer across the full development lifecycle.
• Perform cloud engineering and administration tasks spanning infrastructure, security, and access management; evaluate emerging data engineering trends and enterprise-approved Al tools (GitHub Copilot) to streamline coding, unit testing, and technical documentation.
• Gained hands-on exposure to Azure Event Hub and Azure Stream Analytics for event-driven ingestion patterns and Azure Functions for lightweight serverless processing, supplementing core Databricks/ADF pipeline work.

Azure data engineer

WinWire · Aug 2025 – Present

Not yet confirmed

• Azure Data engineer

Assistant System Engineer-Trainee

Tata Consultancy Services · Apr 2022 – Present

Not yet confirmed

System Engineer

Tata Consultancy Services · Apr 2022 – Present

Not yet confirmed

T

Data Engineer

Tata Consultancy Services (TCS) · May 2022 – Apr 2025

Not yet confirmed

• Delivered a data engineering solution for International Airlines Group, working directly with source data application teams and product owners to design and implement analytics solutions that provide insights for better operational decision-making direct airline industry data domain experience.
• Designed 20+ parameterized Azure Data Factory pipelines with nested ForEach activities, retry logic, and Azure Monitor alerting to orchestrate and schedule complex multi-source batch pipelines, migrating heterogeneous legacy formats (flat files, JSON, XML, Parquet, RDBMS) into governed Azure cloud data lake environments.
• Built and optimized PySpark pipelines in Azure Databricks applying SCD Type 1/2 logic; tuned Spark clusters via adaptive query execution and broadcast joins, cutting average job runtime by 35% through performance tuning.
• Optimized pipeline performance via Z-Ordering and partition pruning on Delta Lake / ADLS Gen2, improving analytical query performance by 40%; applied watermark-based CDC to cut downstream processing time and support near-real-time consumption.

System Engineer

Tata Consultancy Services · Apr 2022 – Mar 2025

Not yet confirmed