Azure data engineer
SCUBEL SOFT SERVICES · Jul 2020 – Jul 2026
- Over 6 years of experience in IT with strong exposure to data engineering and cloud-based data integration solutions.
- More than 5 years of hands-on experience working with Microsoft Azure data platform services.
- Skilled in designing and developing scalable data pipelines using Azure Data Factory for large-scale data ingestion and orchestration.
- Experienced in building big data processing solutions using Azure Databricks with PySpark and Spark SQL.
- Strong experience working with Azure Data Lake Storage Gen2 to manage structured and semi structured datasets.
- Proficient in SQL Server and Azure SQL Database including complex queries, stored procedures, and performance tuning.
- Experienced in SQL development for 1 year, including T-SQL programming, stored procedures, query optimisation, database objects, ETL support, and production troubleshooting.
- Hands-on experience implementing incremental data loading frameworks and automating daily data refresh processes.
- Experience integrating multiple data sources such as relational databases, flat files, and APIs into centralised data platforms.
- Good understanding of data warehousing concepts including dimensional modelling, star schema, and ETL best practices.
- Experience with Azure DevOps for source control, build pipelines, and deployment automation.
- Strong knowledge of monitoring, troubleshooting, and optimising data pipelines in production environments.

