Go Digital Technology Consulting LLP

Senior Data Engineer

Mumbai, India · Pune, India

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

Keywords matched to this posting
Fit score before you apply
Cover letter included

Matched against 2.4M live jobs from 200,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending. ChatGPT: manual setup today.

See how it works

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Role family: Data & ML
Seniority: Senior
Country: IN
Work mode: On-site / unstated
First seen by hirly: 23 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

Location : Mumbai

Experience : 4yrsto 8yrs

Technologies / Skills: Advanced SQL, Python and associated librarieslike Pandas, Numpy etc., Pyspark , Shell scripting, DataModelling, Big data, Hadoop, Hive, ETL pipelines.

Responsibilities :

Proven successin communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and develop data engineering strategy.

Ability to work with business ownersto define key businessrequirements and convert to user stories with required technical specifications.

Communicate results and businessimpacts of insight initiatives to key stakeholders to collaboratively solve business problems.

Working closely with the overall Enterprise Data & Analytics Architect and Engineering practice leads to ensure adherence with the best practices and design principles.

Assures quality, security and compliance requirements are met forsupported area.

Design and create fault-tolerance data pipelinesrunning on cluster

Excellent communication skills with the ability to influence client business and IT teams

Should have design data engineering solutions end to end. Ability to come up with scalable and modular solutions

Required Qualification:

3+ years of hands-on experience Designing and developing Data Pipelinesfor Data Ingestion or Transformation using Python (PySpark)/Spark SQL in AWS cloud

Experience in design and development of data pipelines and processing of data at scale.

Advanced experience in writing and optimizing efficient SQL queries with Python and Hive handling Large Data Sets in Big-Data Environments

Experience in debugging, tunning and optimizing PySpark data pipelines

Should have implemented concepts and have good knowledge of Pyspark data frames, joins, caching, memory management, partitioning, parallelism etc.

Understanding of Spark UI, Event Timelines, DAG, Spark config parameters, in order to tune the long running data pipelines.

Experience working in Agile implementations

Experience with building data pipelinesin streaming and batch mode.

Experience with Git and CI/CD pipelines to deploy cloud applications

Good knowledge of designing Hive tables with partitioning for performance.

Desired Qualification:

Experience in data modelling

Hands on creating workflows on any Scheduling Tool like Autosys, CA Workload Automation

Proficiency in using SDKsfor interacting with native AWS services

Strong understanding of concepts of ETL, ELT and data modeling.

Original posting on Go Digital Technology Consulting LLP's site ↗

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job