sivaji koviri

sivaji koviri

+•• ••••• •••••••••••@•••••.com

Azure Data Engineer · WinWire Technologies · 4.2 yrs

As an Azure Data Engineer, I am driven by a determined ambition to master complex data challenges, leveraging my logical and insightful approach to architect robust, pragmatic solutions. My focus is always on achieving optimal outcomes through meticulous design and a commitment to continuous improvement.

  • Open to Hyderabad
  • On-site

Ask about sivaji

Skills

Claimed

Data EngineeringAI-Assisted DevelopmentRetrieval-Augmented GenerationAI Agent DevelopmentWork Planning and PrioritizationSelf-Directed LearningTeamworkIndependent WorkDatabase Query OptimizationBroadcast Join ImplementationData Salting ImplementationData Partitioning and Segregation Design

Proof of Experience

WinWire Technologies

Azure Data Engineer

WinWire Technologies · Aug 2025 – Present

  • Design, develop, and maintain secure, scalable Spark-based data pipelines in Azure Databricks (PySpark) with Auto Loader and DLT for schema-on-read ingestion of structured, semi-structured, and unstructured data, supporting both batch and streaming workloads.
  • Architect end-to-end ETL/ELT orchestration workflows in Azure Data Factory Linked Services, trigger-based scheduling, and reusable parameterized pipelines - moving data from legacy and on-premises systems (SAP HANA, Veeva CRM, RDBMS) into a modern Azure cloud data lake environment via a metadata-driven ingestion framework.
  • Establish Medallion Architecture (Bronze/Silver/Gold) on Microsoft Fabric Lakehouse using Delta Lake, enforcing schema and row-level data quality validation, and troubleshooting pipeline performance bottlenecks at each layer across the full development lifecycle.
  • Perform cloud engineering and administration tasks spanning infrastructure, security, and access management; evaluate emerging data engineering trends and enterprise-approved Al tools (GitHub Copilot) to streamline coding, unit testing, and technical documentation.
  • Gained hands-on exposure to Azure Event Hub and Azure Stream Analytics for event-driven ingestion patterns and Azure Functions for lightweight serverless processing, supplementing core Databricks/ADF pipeline work.
Tata Consultancy Services (TCS)

Data Engineer

Tata Consultancy Services (TCS) · May 2022 – Apr 2025

  • Delivered a data engineering solution for International Airlines Group, working directly with source data application teams and product owners to design and implement analytics solutions that provide insights for better operational decision-making direct airline industry data domain experience.
  • Designed 20+ parameterized Azure Data Factory pipelines with nested ForEach activities, retry logic, and Azure Monitor alerting to orchestrate and schedule complex multi-source batch pipelines, migrating heterogeneous legacy formats (flat files, JSON, XML, Parquet, RDBMS) into governed Azure cloud data lake environments.
  • Built and optimized PySpark pipelines in Azure Databricks applying SCD Type 1/2 logic; tuned Spark clusters via adaptive query execution and broadcast joins, cutting average job runtime by 35% through performance tuning.
  • Optimized pipeline performance via Z-Ordering and partition pruning on Delta Lake / ADLS Gen2, improving analytical query performance by 40%; applied watermark-based CDC to cut downstream processing time and support near-real-time consumption.

Proof-of-Work

No completed sessions yet. Anything sivaji finishes shows up here with the evidence behind it.

Proof of Education

B.Tech, Computer Science and Engineering

Jawaharlal Nehru Technological University (JNTU), Kakinada · 2017 — 2021

A Proof CV — one profile, kept current, with the proof attached. Back to the portal