Manan Guglani

As a Senior Data Engineer with 6 years of experience, I am driven by a deep curiosity and ambition to master complex data challenges, always seeking innovative and collaborative solutions. My approach is rooted in an open-minded idealism, where I strive to build impactful systems that not only solve immediate problems but also envision future possibilities and user needs with empathy.

Experience

F

Senior Data Engineer (Official: Integration Developer)

Five Below (via WowtownAI Technologies) · Sep 2024 – Present

Not yet confirmed

• Engineered 50+ data pipelines following Medallion Architecture, processing 10M+ daily supply chain records, enabling upstream and downstream data integrations, orchestrating Databricks jobs using Airflow.
• Migrated 350+ DAGs from Airflow v2 to v3 on Astronomer Cloud, collaborating across engineering teams to ensure a zero-downtime production transition.
• Led the upgrade of 450+ Databricks notebooks, 100+ workflows to Databricks Runtime 15.4 LTS, including compute cluster upgrades, resolving library compatibility issues, and end-to-end regression testing.
• Executed Unity Catalog enablement in MOVE domain's workspace by collaborating with an external vendor to configure catalogs, schemas, and permissions, validating cluster and storage access, with zero-impact production cutover.
• Executed Blob to ADLS Gen2 migration by provisioning target storage, migrating datasets, configuring access permissions, updating storage references across Databricks notebooks, and validating data ingestion.
• Resolved 2,500+ SonarQube issues across multiple repos by introducing reusable utilities and standardized error handling, leveraging Cursor AI, reducing resolution time to one-fourth of the manual effort, achieving full compliance.
• Developed shell scripts for server-side automation, including system reboot orchestration and operational utility tasks, reducing manual intervention.

Senior Data Engineer

Five Below · Sep 2024 – Present

Not yet confirmed

• Official: Integration Developer in Five Below's MOVE (supply-chain) team via WowtownAI Technologies.
• • Engineered 50+ data pipelines following Medallion Architecture, processing 10M+ daily supply chain records, enabling upstream and downstream data integrations, orchestrating Databricks jobs using Airflow.
• • Migrated 350+ DAGs from Airflow v2 to v3 on Astronomer Cloud, collaborating across engineering teams to ensure a zero-downtime production transition.
• • Led the upgrade of 450+ Databricks notebooks, 100+ workflows to Databricks Runtime 15.4 LTS, including compute cluster upgrades, resolving library compatibility issues, and end-to-end regression testing.
• • Executed Unity Catalog enablement in MOVE domain’s workspace by collaborating with an external vendor to configure catalogs, schemas, and permissions, validating cluster and storage access, with zero-impact production cutover.
• • Executed Blob to ADLS Gen2 migration by provisioning target storage, migrating datasets, configuring access permissions, updating storage references across Databricks notebooks, and validating data ingestion.
• • Resolved 2,500+ SonarQube issues across multiple repos by introducing reusable utilities and standardized error handling, leveraging Cursor AI, reducing resolution time to one-fourth of the manual effort, achieving full compliance.
• • Developed shell scripts for server-side automation, including system reboot orchestration and operational utility tasks, reducing manual intervention.

Senior Solution Consultant

Caelius Consulting · Jan 2022 – Sep 2024

Not yet confirmed

• Designed and delivered enterprise integration solutions for multiple clients across various domains, enabling secure data exchange for 1M+ records between ERP, CRM, WMS, payment gateways, and third-party systems.
• Built 25+ event-driven streaming pipelines using message queues to process real-time data from upstream systems, implementing orchestration logic, complex transformations, schema validation, and data mapping.
• Managed the complete API lifecycle, including design, development, testing, deployment, versioning, monitoring, and production support, following API-led connectivity principles with robust error handling and retry mechanisms.
• Developed RDS-based logging and observability framework for high-volume batch integrations, enabling end-to-end monitoring, variance analysis, failure detection, and audit reporting across data exchanges between 3PL and NetSuite.
• Earned 4 MuleSoft and AI certifications and received the Future Legend and Go That Extra Mile awards.
• Presented a technical session on Streaming at the Chandigarh MuleSoft Meetup and authored a blog.

Senior Solution Consultant

Caelius Consulting · Jan 2022 – Sep 2024

Not yet confirmed

• • Designed and delivered enterprise integration solutions for multiple clients across various domains, enabling secure data exchange for 1M+ records between ERP, CRM, WMS, payment gateways, and third-party systems.
• • Built 25+ event-driven streaming pipelines using message queues to process real-time data from upstream systems, implementing orchestration logic, complex transformations, schema validation, and data mapping.
• • Managed the complete API lifecycle, including design, development, testing, deployment, versioning, monitoring, and production support, following API-led connectivity principles with robust error handling and retry mechanisms.
• • Developed RDS-based logging and observability framework for high-volume batch integrations, enabling end-to-end monitoring, variance analysis, failure detection, and audit reporting across data exchanges between 3PL and NetSuite.
• • Earned 4 MuleSoft and AI certifications and received the Future Legend and Go That Extra Mile awards.
• • Presented a technical session on Streaming at the Chandigarh MuleSoft Meetup and authored a blog.

K

DevOps Engineer Intern

Kpoint Technologies · Aug 2021 – Dec 2021

Not yet confirmed

• Assisted in building and maintaining CI/CD pipelines for deployments using Git/GitHub and Azure DevOps.
• Developed automation scripts and managed configurations on Linux servers supporting production deployments.
• Implemented alerts, monitoring and logging setup for application services to ensure operational reliability.

DevOps Engineer

KPOINT · Aug 2021 – Dec 2021

Not yet confirmed

• • Assisted in building and maintaining CI/CD pipelines for deployments using Git/GitHub and Azure DevOps.
• • Developed automation scripts and managed configurations on Linux servers supporting production deployments.
• • Implemented alerts, monitoring and logging setup for application services to ensure operational reliability.