Shivakaran Puramachety

Shivakaran Puramachety

+•• ••••• •••••••••••@•••••.com

Senior Data Engineer · Intellect Design Arena Ltd · 6.1 yrs

As a Senior Data Engineer, I am driven by a deep curiosity to independently explore complex data challenges and an ambitious pursuit of innovative AI solutions. I thrive on the autonomy of architecting robust ETL pipelines, always holding myself accountable for delivering high-performance, impactful systems that align with an ideal vision for data-driven insights.

  • Hyderabad, Telangana, India

Ask about Shivakaran

Skills

Claimed

Dynamic SQL ImplementationSnowflake Tasks UsageSnowpipe UsageTest ExecutionBraze UsageCode StandardizationVisual Studio Code Extension DevelopmentRequirements AnalysisTechnical Input ProvisionBlocker Identification and ResolutionCI/CD Pipeline ImplementationProject Status Communication

Proof of Experience

Senior Data Engineer

Intellect Design Arena Ltd · Jul 2024 – Present

  • Built an internal SQL code scanner for wealth management projects using Purple Fabric (an internal AI agent generator tool), extending the company's SonarQube-based code scanning - previously available only for Python - to SQL codebases.
  • Resolved execution and data issues on a capital gains tax report that had repeatedly missed deadlines, enabling on-time delivery to the client.
  • Develop and maintain ETL processes to optimize data extraction and transformation across enterprise data sources.
  • Collaborate with cross-functional teams to integrate AI solutions into existing data systems.
  • Build and support pipelines using Snowflake, Matillion, AWS, Azure, MySQL, Python, and LangChain.

Senior Data Engineer

Massive Rocket · Jan 2024 – Jul 2024

  • Designed and executed a strategy to resolve customer duplication across ~420K customer profiles between the data warehouse and the Braze CRM platform, completing the fix in under two weeks.
  • Executed data integration from diverse source systems into centralized storage.
  • Conducted data quality checks to ensure dataset accuracy and reliability.
  • Managed data flow between the data warehouse and CRM tool in Snowflake using Python API gateways.
  • Utilized Databricks, PySpark, and SQL for large-scale data processing.

Senior Data Engineer

Generation Organisation · Sep 2022 – Jan 2024

  • Designed and built an automated Snowflake access-provisioning process for employees across 14 countries: access requests are uploaded as files to S3, picked up by Snowpipe, and provisioned via a stored procedure that generates dynamic SQL - replacing manual request handling.
  • Designed and developed ETL processes based on user requirements for enterprise data loading into the Data Warehouse.
  • Built and maintained scalable data pipelines, improving data processing efficiency.
  • Automated data quality checks and error handling to ensure dataset integrity.
  • Optimized SQL queries and database schemas to enhance data retrieval performance.
  • Delivered projects using Snowflake, Matillion, AWS (Lambda, Glue, S3), MySQL, and Snowpark.

Analyst (IT) - Senior Data Engineer

Merilytics · Oct 2021 – Sep 2022

  • Optimized an SSAS data model for a client campaign-analysis report, reducing model size from 1.5 GB to 420 MB (72% reduction) with no loss of report detail or accuracy, lowering client infrastructure cost.
  • Engineered cloud-native ETL workflows on Snowflake and Azure using ADF, Logic Apps, and Functions.
  • Developed data pipelines to support efficient analytics and reporting.
  • Performed SQL optimization and built data models for large datasets.
  • Created visualizations in Power BI to clarify complex analyses for end users.
  • Managed user accounts, roles, and privileges across databases.
  • Monitored database performance proactively and resolved issues in a timely manner.

Senior Technical Associate - Data Engineer

Merilytics© · Apr 2021 – Oct 2021

Technical associate - Data engineer

Merilytics · Oct 2020 – Apr 2021

Proof-of-Work

No completed sessions yet. Anything Shivakaran finishes shows up here with the evidence behind it.

Proof of Education

Bachelor of Technology - BTech, Mechanical Engineering

Chaitanya Bharathi Institute Of Technology · 2016 — 2020

A Proof CV — one profile, kept current, with the proof attached. Back to the portal