RJ

Rohan Joshi

As a data engineer, I approach challenges with a logical and pragmatic mindset, driven by a deep ambition for mastery and continuous improvement. My self-discipline and determination ensure I consistently deliver robust and efficient data solutions, always striving for excellence in complex system design.

Contact details — on requestProof of Work — on request

Experience

G

Associate Data Engineer

Growsoft India · Dec 2022 – Present

Not yet confirmed
  • Designed, built, and maintained scalable ETL pipelines across Raw, Bronze, and Silver layers using AWS Databricks, PySpark, and Delta Lake.
  • Implemented incremental data ingestion from Amazon S3 using Databricks Auto Loader with schema evolution, rescue mode, and checkpointing.
  • Configured secure connectivity between Databricks and Amazon S3 using AWS IAM Roles, Unity Catalog Storage Credentials, and External Locations.
  • Developed Structured Streaming pipelines (readStream) to incrementally process data from Bronze Delta tables.
  • Performed data cleaning and validation using PySpark, including null handling, data type casting, duplicate removal, and data quality checks before loading data into the Silver layer.
  • Loaded curated data into Silver Delta tables using foreachBatch and Delta MERGE for incremental upserts.
  • Contributed to business transformations for Gold datasets using SQL and PySpark, including joins, filtering, aggregations, and window functions.
  • Supported loading Gold Delta datasets into Snowflake using the COPY INTO command for analytics and business reporting.
  • Worked in a project environment where Apache Airflow was used for workflow orchestration.
  • Optimized Spark and Delta Lake workloads using partitioning, caching, and Databricks cluster optimization techniques.
  • Worked with Unity Catalog by managing catalogs, schemas, governed Delta tables, Storage Credentials, External Locations, and implementing row, column, and table-level access controls.
  • Worked with dimensional data models, including Fact Tables, Dimension Tables, Star Schema, and table relationships to support ETL development and analytical reporting.
S

Specialist II in the Production Department

Sanjeev Auto Parts Manufacturers Pvt. Ltd. · May 2020 – Feb 2022

Not yet confirmed
  • Analyzed SAP MM and production data using Microsoft Excel to support operational reporting and businessdecision-making.
  • Performed data validation, data cleansing, and reconciliation to ensure reporting accuracy and dataconsistency.
  • Prepared daily, weekly, and monthly MIS reports for procurement, inventory, and production tracking.
  • Developed interactive Power BI dashboards to visualize inventory, procurement, and production KPIs.
  • Utilized Pivot Tables, VLOOKUP, and advanced Excel functions to analyze large datasets and generatebusiness insights.
  • Monitored production and procurement data to identify trends, discrepancies, and process improvementopportunities.
  • Collaborated with cross-functional teams to ensure accurate reporting and support operational planning.
  • Supported procurement operations by working across the Procure-to-Pay (P2P) cycle, including RFQ, Purchase Orders (PO), vendor coordination,

Skills 0 proven through work

Also works with

Work Planning and PrioritizationTask UnderstandingSAP System KnowledgeAuto Scaling Group CreationApache Iceberg UsageData OptimizationBroadcast Join ImplementationData SortingData ShufflingProcessing Pipeline OptimizationData Integrity ManagementData PreprocessingData Repetition PreventionTypecastingDatabricks UsageAWS DeploymentPySparkSQL ProgrammingPython DevelopmentData LoadingData TransformationData ExtractionData ProvisionTabular Data Cleaning & ValidationETL Pipeline Development

Proof of Work

Proof of Work

Rohan shares this with people who ask. You'll hear back either way.

Education

Bachelors of Engineering, Engineering

Dr.BAMU · NaN — 2019

Diploma, DME

MSBTE · NaN — 2015

Higher Secondary Certificate, HSC

MSB · NaN — 2013

Secondary School Certificate, SSC

MSB · NaN — 2011

Contact details

Contact details

Rohan shares this with people who ask. You'll hear back either way.

Ask about this candidate

ClaudeChatGPTPerplexity

AI responses may contain errors. Proof status and source information are provided by Proof of Skill.

A Proof CV — one profile, kept current, with the proof attached. Back to the portal