Jaideep Rana
Contact details — on requestProof of Work — on request
Experience
Data Engineer
Cognizant · Aug 2024 – Present
- Designed and developed robust and scalable big data pipelines using AWS Glue, Bash, hive, Oracle, Apache PySpark.
- Implemented ETL processes to transform and load data from various sources into an Oracle database
- Automated data workflows with Linux scripting, ensuring efficient data processing and error handling, reducing manual effort by 40 percent.
- Worked on Spark and Query Performance Tuning resulting in reducing time taken by 20 percent and AWS Cost optimization
- Processed and analyzed 10TB of batch data using Hadoop, PySpark and Apache Hive for an ATT Payment Analytic engine, resulting in a 20 percent increase in customer engagement
- Utilized PyApache Spark to perform complex transformations and aggregations on 3TB of financial transaction data
- Implemented data quality checks and governance frameworks to ensure accurate and consistent data using bash and Apache Hive scripts
- Led a team of Data Engineers, providing technical guidance, mentoring, training, upskill new team members and architectural direction to deliver high-quality, scalable data solutions aligned with business goals.
Specialist Programmer
Infosys · Aug 2021 – Present
Data Engineer
Infosys · Aug 2021 – Aug 2024
- Developed a java module which calculate discount, remaining due, classify and group payments.
- Worked on integrating third party vendor payments and incorporate it with already existing rules for discount.
- Worked on module which filter, categorise and validates different rules based on valid specified criteria and integrate with bash script
- Utilized Jenkins to provide a continuous integration service in order to automate the entire process of loading the latest build code and test files, running the tests, and generating a report of the results once per day.
- Worked on data migration to transfer data from onprem to AWS.
P
Big Data Developer Intern
PWC US · Feb 2021 – Jul 2021
- Assisted in development of pipeline for Batch Data flow to track and manage Goods shipped.
- Worked on Bash Script that perform ETL, Sqoop data from Oracle to AWS S3.
- Collaborated with team members using version control systems such as Git to organize modifications and assign tasks.
Data Engineer Intern
PWC US-ADV · Feb 2021 – Jul 2021
Skills 0 proven through work
Also works with
Transaction GroupingHive UsageData VisualizationComponent IntegrationCross-Departmental CoordinationProblem SolvingCreative BrainstormingTeamworkPython DevelopmentData Architecture DesignPower BIData TransformationData EngineeringAmazon S3Operations Data TrackingAWS GlueETL Pipeline DevelopmentBulk Data ProcessingCustomer Retention and Churn PreventionBusiness Growth StrategyBusiness IntelligenceAutomated Summarization SystemsLarge Dataset HandlingRule-Based Decision Logic ImplementationBusiness Logic ImplementationFinancial Charge Calculation Engine DevelopmentData Module DevelopmentJava DevelopmentAWS EMR UsageProcess ImprovementCloud Cost Estimation & ComparisonCode RefactoringPerformance TestingBroadcast Join ImplementationGeneral ScriptingTabular Data Cleaning & ValidationSpark SQLDatabase Query OptimizationCode OptimizationData Migration
Proof of Work
Proof of Work
Jaideep shares this with people who ask. You'll hear back either way.
Education
Bachelor of Technology, Computer Science Engineering
Maharishi Markandeshwar University · 2017 — 2021
Contact details
Contact details
Jaideep shares this with people who ask. You'll hear back either way.
Ask about this candidate
AI responses may contain errors. Proof status and source information are provided by Proof of Skill.
A Proof CV — one profile, kept current, with the proof attached. Back to the portal