hirly
Sign inGet started free

cognine

Big Data Engineer

Hyderabad, India

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at cognine first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.4M live jobs from 200,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending. ChatGPT: manual setup today.

See how it works

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Role family
Data & ML
Seniority
Mid level
Country
IN
Work mode
On-site / unstated
First seen by hirly
23 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

Job Summary:

We are looking for a skilled Big Data Engineer with strong experience in PySpark and data engineering. The ideal candidate will have hands-on experience in building scalable data pipelines, working with streaming data, and cloud platforms. Experience with Palantir Foundry is highly preferred

Experience Required: 5 – 10 years

Key Responsibilities:

  • Design, develop, and maintain ETL/data pipelines using Python and PySpark
  • Work with real-time/streaming data systems
  • Build and optimize data processing solutions on cloud platforms
  • Collaborate with cross-functional teams to understand business requirements
  • Develop and maintain CI/CD pipelines
  • Ensure data quality, performance, and scalability

Required Skills:

  • 5–10+ years of experience in Data Engineering
  • Strong expertise in Python and PySpark
  • Experience with Kafka, Flink, and Kubernetes
  • Hands-on with Big Data technologies (Hadoop, Spark, MongoDB)
  • Experience with cloud platforms (Azure, AWS, or GCP)
  • Good understanding of data architecture and pipeline design

Preferred Skills:

  • Experience with Palantir Foundry
  • Knowledge of Java
  • Experience in consulting or Utilities domain
Original posting on cognine's site ↗

Similar jobs

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job