hirly

Infosys

Azure Databricks & PySpark Principal Consultant

Bangalore, India

hirly Pro

Get in front of the people hiring at Infosys

  • Reach the hiring manager at Infosys on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Infosys, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Infosys first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.9M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Lead / management
Country
IN
Work mode
On-site / unstated
First seen by hirly
12 Oct 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

We are looking for an experienced Data Engineer with 12-16 years of overall IT experience and strong expertise in Azure Databricks and PySpark. The ideal candidate should have extensive experience in building scalable data pipelines, processing large datasets, and delivering enterprise-grade data solutions on the Azure platform.

Responsibilities

Design, develop, and optimize large-scale data pipelines using Azure Databricks and PySpark.

Build and maintain ETL/ELT workflows using Azure Data Factory.

Develop scalable data processing frameworks for batch and near real-time data ingestion.

Implement data transformation, cleansing, and enrichment processes.

Work with large-scale structured and unstructured datasets in Azure Data Lake.

Optimize Spark jobs for performance, scalability, and cost efficiency.

Collaborate with business stakeholders, architects, and analytics teams to deliver data solutions.

Ensure data quality, security, governance, and compliance standards are met.

Provide production support, troubleshoot issues, and drive continuous improvements.

Mentor junior team members and contribute to technical solution design.

Technical requirements

12-16 years of IT experience with strong Data Engineering expertise.

Hands-on experience in Azure Databricks and PySpark development.

Strong knowledge of Azure Data Factory (ADF).

Expertise in SQL and Data Warehousing concepts.

Experience with Azure Data Lake Storage (ADLS Gen2).

Strong understanding of Spark architecture and performance tuning.

Experience designing and implementing enterprise-scale data pipelines.

Knowledge of CI/CD and Agile delivery practices.

Education

MBA,MCA,ME,MSc,MTech,Bachelor of Engineering,BCA,BSc,BTech

Original posting on Infosys's site ↗

Listed on hirly, a job board. hirly is not the employer: Infosys is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job