anil pami

+•• ••••• •••••••••••@•••••.com

Senior Software Engineer · HCL Tech · 5.9 yrs

  • Hyderabad
  • Open to Hyderabad
  • On-site

Ask about anil

Skills

Claimed

Informatica IDQ UsageEnd-to-End System UnderstandingBusiness Logic AnalysisData Discrepancy InvestigationTeamworkAdaptabilityWork Planning and PrioritizationMaintainability DesignReliability ImprovementProblem SolvingCustom Component DevelopmentExploratory Data Analysis (EDA)

Proof of Experience

HCL Tech

Senior Software Engineer

HCL Tech · Sep 2025 – Present

  • Led the end-to-end migration of NBC Universal's on-premise Film Data Warehouse from Teradata + Informatica PowerCenter to a cloud-native lakehouse on Azure Databricks, modernizing 200+ legacy ETL workflows into PySpark notebooks and dbt models on Delta Lake.
  • Architected the medallion (Bronze / Silver / Gold) data architecture on ADLS Gen2 + Delta Lake, processing 5+ TB of film, marketing, and financial data daily across box-office, distribution, and royalty domains.
  • Built 60+ Airflow DAGs to orchestrate ingestion, transformation, and publishing pipelines, replacing Autosys schedules; implemented dynamic task generation, SLA monitoring, retries, and Slack-based alerting to reduce on-call incidents by ~40%.
  • Developed reusable PySpark frameworks for incremental ingestion, schema-evolution handling, and SCD Type 2 maintenance on Delta tables adopted across 4+ downstream domains.
  • Engineered a dbt-based transformation layer (60+ models) with tests, snapshots, and documentation, enabling self-service analytics for marketing and finance teams and cutting analyst data-prep time by ~50%.
  • Implemented IICS (Informatica Intelligent Cloud Services) hybrid pipelines using Secure Agents to bridge on-premise Oracle and Teradata sources with Azure cloud targets during the multi-year migration.
  • Tuned long-running Spark jobs by re-partitioning skewed datasets, adopting Delta Lake Z-Order indexing, and adjusting AQE settings
  • reducing critical pipeline runtimes from ~3 hours to under 45 minutes.
  • Set up Unity Catalog for fine-grained access control and lineage across the lakehouse; partnered with the governance team to define table ownership, tags, and column-level masking for PII fields.
  • Mentored 3 junior engineers on PySpark best practices, code reviews, and Airflow DAG design; introduced a peer-review checklist that reduced production hotfixes by ~30%.

Software Engineer

Asics Technologies · Feb 2022 – Jul 2025

  • Designed and delivered ETL pipelines for F&G's policy administration, claims, and actuarial data supporting daily and intraday loads into the enterprise data warehouse used for regulatory reporting.
  • Migrated select Informatica PowerCenter workflows to IICS Cloud Data Integration (Mapping Tasks, Synchronization Tasks), enabling hybrid cloud connectivity and reducing licensing footprint.
  • Built complex mappings using Router, Aggregator, Joiner, Expression, Lookup, Update Strategy, Sequence Generator, and Stored Procedure transformations across both PowerCenter and IICS.
  • Performance-tuned high-volume mappings by introducing pushdown optimization, partitioning, and lookup caching
  • reducing nightly batch runtime by ~35% and eliminating recurring SLA breaches.
  • Authored 100+ Unix shell scripts for file watchers, archival, and pre/post-load validations; coordinated complex cross-system dependencies in Control-M between PowerCenter and IICS schedules.
  • Partnered with QA and business analysts to define impact-analysis documents and unit test cases, ensuring zero-defect production releases across multiple quarterly cycles.
  • Owned production support for Canon's enterprise data integration platform, monitoring 150+ daily ETL jobs across PowerCenter and IICS via DAC and the Monitoring & Execution App (MEA).
  • Diagnosed and resolved P1/P2 incidents within tight SLAs by analyzing Oracle source/target data, session logs, and lookup behavior - maintained ~99.5% on-time job completion.
  • Delivered 20+ enhancement requests including new mappings, schema changes, and reusable transformation components across both PowerCenter and IICS environments.
  • Drove root-cause analysis sessions with cross-functional teams (developers, DBAs, business stakeholders) and produced post-incident runbooks that became standard team references.

Software Engineer

MOVATE TECHNOLOGIES · Oct 2020 – Jan 2022

  • Built data quality and profiling rules in Informatica IDQ and IICS Data Quality to support Symphony Health's patient-journey analytics for the life-sciences industry.
  • Led IDQ server migration tasks and developed comparison scripts for complex data-quality checks across Oracle and file-based sources.
  • Configured IICS connections and runtime environments (Secure Agents) to enable hybrid data-quality pipelines spanning on-premise databases and cloud targets.
  • Authored technical documentation for DQ rules and validation scripts, accelerating onboarding of new engineers and reducing rule-development time for subsequent enhancements.

Proof-of-Work

No completed sessions yet. Anything anil finishes shows up here with the evidence behind it.

Proof of Education

Bachelor of Technology (B.Tech), Technology

Vinayaka Missions University, Salem · 2015 — 2019

A Proof CV — one profile, kept current, with the proof attached. Back to the portal