Shivakaran Puramachety
Senior Data Engineer | Snowflake, Azure (ADF, Synapse, Functions, Logic Apps, Analysis Services, Databricks) | AWS (Glue, Lambda) | Matillion, Python, SQL, Power BI | Security & AI/LLM (LangChain, Snowpark, Spark) · Hyderabad, Telangana, India
As a Senior Data Engineer, I am driven by a deep curiosity to independently explore complex data challenges and an ambitious pursuit of innovative AI solutions. I thrive on the autonomy of architecting robust ETL pipelines, always holding myself accountable for delivering high-performance, impactful systems that align with an ideal vision for data-driven insights.
Experience
Senior Data Engineer
Intellect Design Arena Ltd · Jul 2024 – Present
- Built an internal SQL code scanner for wealth management projects using Purple Fabric (an internal AI agent generator tool), extending the company's SonarQube-based code scanning - previously available only for Python - to SQL codebases.
- Resolved execution and data issues on a capital gains tax report that had repeatedly missed deadlines, enabling on-time delivery to the client.
- Develop and maintain ETL processes to optimize data extraction and transformation across enterprise data sources.
- Collaborate with cross-functional teams to integrate AI solutions into existing data systems.
- Build and support pipelines using Snowflake, Matillion, AWS, Azure, MySQL, Python, and LangChain.
Senior Data Engineer
Massive Rocket · Jan 2024 – Jul 2024
- Designed and executed a strategy to resolve customer duplication across ~420K customer profiles between the data warehouse and the Braze CRM platform, completing the fix in under two weeks.
- Executed data integration from diverse source systems into centralized storage.
- Conducted data quality checks to ensure dataset accuracy and reliability.
- Managed data flow between the data warehouse and CRM tool in Snowflake using Python API gateways.
- Utilized Databricks, PySpark, and SQL for large-scale data processing.
Senior Data Engineer
Generation Organisation · Sep 2022 – Jan 2024
- Designed and built an automated Snowflake access-provisioning process for employees across 14 countries: access requests are uploaded as files to S3, picked up by Snowpipe, and provisioned via a stored procedure that generates dynamic SQL - replacing manual request handling.
- Designed and developed ETL processes based on user requirements for enterprise data loading into the Data Warehouse.
- Built and maintained scalable data pipelines, improving data processing efficiency.
- Automated data quality checks and error handling to ensure dataset integrity.
- Optimized SQL queries and database schemas to enhance data retrieval performance.
- Delivered projects using Snowflake, Matillion, AWS (Lambda, Glue, S3), MySQL, and Snowpark.
Analyst (IT) - Senior Data Engineer
Merilytics · Oct 2021 – Sep 2022
- Optimized an SSAS data model for a client campaign-analysis report, reducing model size from 1.5 GB to 420 MB (72% reduction) with no loss of report detail or accuracy, lowering client infrastructure cost.
- Engineered cloud-native ETL workflows on Snowflake and Azure using ADF, Logic Apps, and Functions.
- Developed data pipelines to support efficient analytics and reporting.
- Performed SQL optimization and built data models for large datasets.
- Created visualizations in Power BI to clarify complex analyses for end users.
- Managed user accounts, roles, and privileges across databases.
- Monitored database performance proactively and resolved issues in a timely manner.
Senior Technical Associate - Data Engineer
Merilytics© · Apr 2021 – Oct 2021
Technical associate - Data engineer
Merilytics · Oct 2020 – Apr 2021
Skills 0 proven through work
Also works with
Proof of Work
Proof of Work
Shivakaran shares this with people who ask. You'll hear back either way.
Education
Bachelor of Technology - BTech, Mechanical Engineering
Chaitanya Bharathi Institute Of Technology · 2016 — 2020
Contact details
Contact details
Shivakaran shares this with people who ask. You'll hear back either way.
What drives their work
The Architect
You design and construct robust, automated systems that streamline complex processes.
Shivakaran's superpower
You excel at identifying systemic inefficiencies and engineering comprehensive, automated solutions that deliver reliable and optimized outcomes.
How Shivakaran works
You would thrive in a team focused on building scalable, efficient data infrastructure and fostering technical growth.
Ask about this candidate
AI responses may contain errors. Proof status and source information are provided by Proof of Skill.
A Proof CV — one profile, kept current, with the proof attached. Back to the portal