A
Akhileswar
As an Azure Data Engineer, I approach every challenge with a diligent and logical mindset, ensuring accountability in delivering robust and high-quality data solutions. My ambition is fueled by a continuous pursuit of mastery, always striving for ideal architectural designs and optimal performance.
Contact details — on requestProof of Work — on request
Experience
M
Azure Data Engineer
Microgate Technologies Pvt Ltd. · Jan 2025 – Apr 2026
- Designed and developed end-to-end ETL/ELT data pipelines using Azure Databricks and PySpark.
- Implemented the Medallion Architecture (Bronze, Silver, Gold) for scalable and reliable data processing.
- Ingested raw CSV data into Azure Data Lake Storage Gen2 using Auto Loader (Streaming) and Batch processing.
- Developed Bronze layer pipelines to store raw data while maintaining the source of truth.
- Built Silver layer transformations to remove duplicates, handle null values, standardize data types, and apply business rules.
- Created Gold layer datasets for business reporting, including Ticket Volume Trends, SLA Compliance, Resolution Status, and Department-wise Analytics.
- Implemented Delta Live Tables (DLT) to automate pipeline orchestration, dependency management, and data quality validation.
- Configured DLT Expectations for enforcing data quality and maintaining data lineage.
- Managed Delta Lake tables using Unity Catalog for centralized governance, metadata management, and access control.
- Optimized Spark jobs using partitioning, caching, and Delta Lake optimization techniques to improve pipeline performance.
- Developed PySpark notebooks for data ingestion, transformation, and aggregation.
- Implemented incremental file processing using Auto Loader to process only newly arrived files.
- Created reusable notebooks and parameterized pipelines for different environments.
- Developed SQL queries for data validation and business metric generation.
- Built interactive dashboards using Streamlit to monitor DLT pipelines and visualize silver and gold layer data.
L
Senior Research Engineer
LG Soft India · Aug 2024 – Jan 2025
- Creating stored Procedures and scheduled them in Azure Environment.
- Designed, developed, and tested various Power BI visualizations for dashboard and databases Creating Complex SQL Queries.
- Expertise in data preparation, including blending multiple data connections and creating joins across different sources.
- Ability to understand requirements and changes to requirements.
- Building the pipeline to copy the data from source to destination in Azure Data Factory.
- Worked on creating dependencies of activities in Azure Data factory.
- Work Experience with data engineering tools like data bricks / frameworks on cloud for Object-oriented/object function scripting using languages such as Python, Spark, or similar.
- Strong ability to design, build and manage data pipelines in Spark, Apache Airflow and related technologies for data structures encompassing data transformation, data models, schemas, metadata, and workload management.
- Strong experience with popular database programming in relational and non-relational environments like Snowflake, Azure SQL DB, and similar platforms.
H
Software Developer
Helson software Solutions · Jan 2021 – Aug 2024
- Developed Azure Data Factory (ADF) pipelines to ingest data from SQL Server, REST APIs, FTP servers, SharePoint lists, CSV, and Excel files.
- Created reusable Linked Services, Datasets, and parameterized pipelines to build dynamic and scalable ETL workflows.
- Implemented Full Load and Incremental Load (Delta Load) processes using watermark columns and timestamps.
- Developed Azure Databricks notebooks using PySpark for data cleansing, transformation, validation, and business rule implementation.
- Loaded processed data into Azure SQL Database for reporting and downstream applications.
- Created and optimized complex SQL queries, Stored Procedures, Views, Triggers, Cursors, and Joins for ETL and reporting requirements.
- Developed SSIS packages to extract and transform data from SQL Server databases and SharePoint lists.
- Migrated existing SSIS packages to Azure using Azure-SSIS Integration Runtime.
- Evaluated and migrated on-premises SQL Server databases to Azure SQL Database.
- Created SQL datasets and data models for Power BI dashboards and ad-hoc business reports.
- Designed and developed interactive Power BI dashboards with KPIs, drill-down reports, filters, and visualizations.
- Developed SSRS reports using tables, matrices, charts, and sub-reports, and deployed them to Report Manager.
- Scheduled ETL pipelines using Azure Data Factory Triggers and monitored executions to resolve failures and improve reliability.
- Performed production support by troubleshooting ETL failures, fixing data quality issues, and optimizing pipeline performance.
Skills 0 proven through work
Also works with
UI Performance OptimizationRapid Technology OnboardingTaking OwnershipRapid LearningProblem SolvingAdaptive PlanningAdaptabilityWork Planning and PrioritizationData-Driven RecommendationsData Accessibility ImprovementProcess ImprovementFeasibility and Impact AssessmentSelf-Directed LearningLarge Dataset HandlingSQL ProgrammingPython DevelopmentEffective CommunicationProject Status CommunicationFunctional TestingCodingCode ReviewRequirements AnalysisClean Code PracticesSoftware Quality AssuranceDecision MakingImpact AnalysisTeamworkCode RefactoringDatabase Query AnalysisPerformance Metrics AnalysisSolution ImplementationTechnical TroubleshootingMemory ManagementAPI Caching ImplementationDatabase Query OptimizationApplication Performance OptimizationData MonitoringData CompressionData EngineeringMetadata ManagementData OptimizationProcessing Pipeline OptimizationWatermark Column ImplementationIncremental Data ProcessingETL Pipeline DevelopmentError HandlingData ValidationData TransformationPySparkDatabricks UsageAzure Data Factory Pipeline DevelopmentData ModelingAPI IntegrationJSON Data Handling
Proof of Work
Proof of Work
Akhileswar shares this with people who ask. You'll hear back either way.
Education
Bachelor of Technology, Technology
JNTUA · 2016 — 2020
Contact details
Contact details
Akhileswar shares this with people who ask. You'll hear back either way.
What drives their work
The Architect
They design and build the underlying structures that ensure systems are robust and performant.
Akhileswar's superpower
You excel at diagnosing systemic inefficiencies and engineering robust, scalable solutions.
How Akhileswar works
You are well-suited for teams focused on building and maintaining scalable, high-performance data infrastructure and applications.
Ask about this candidate
AI responses may contain errors. Proof status and source information are provided by Proof of Skill.
A Proof CV — one profile, kept current, with the proof attached. Back to the portal