DATABEAT
Senior Databricks Engineer
Hyderabad, India
hirly Pro
Get in front of the people hiring at DATABEAT
- Reach the hiring manager at DATABEAT on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at DATABEAT, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Seniority
- Senior
- Country
- IN
- Work mode
- On-site / unstated
- First seen by hirly
- 23 Sept 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
Job Title: Senior Databricks Engineer
Experience Required: 8+ Years
Role Summary
We are seeking an experienced Senior Databricks Developer with 8+ years of experience in Data Engineering, Big Data, and Cloud Analytics solutions, including extensive hands-onexpertise in Databricks, Apache Spark, PySpark, SQL, and Delta Lake. The ideal candidate will be responsible for leading end-to-end data engineering projects, engaging directly with clients and business stakeholders, mentoring development teams, and delivering scalable, secure, and high-performance data platforms across Azure and AWS environments.
This role requires strong technical leadership, solution design capabilities, stakeholder management skills, and the ability to drive data transformation initiatives from requirements gathering through deployment and production support.
Technical Expertise
Databricks (PySpark, SQL, Notebooks, Workflows) , Apache Spark , Delta Lake , Python, Azure
Data Factory (ADF) ,Azure Synapse Analytics ,AWS S3, Glue, Lambda , Unity Catalog
MLflow ,Databricks Job Clusters ,CI/CD Pipelines ,GitLab / GitHub ,Data Governance & Data
Quality Frameworks, Power BI / Tableau , Data Cataloging ,Lakehouse Architecture ,Medallion
Architecture, Performance Tuning & Optimization
Key Responsibilities
Lead the design, development, and implementation of enterprise-scale data engineering
solutions using Databricks, PySpark, SQL, and Delta Lake.
Own end-to-end project delivery, including requirement gathering, solution design,
development, testing, deployment, and production support.
Collaborate directly with clients, business stakeholders, architects, and product owners to
understand business requirements and translate them into scalable technical solutions.
Conduct client discussions, solution workshops, effort estimations, technical presentations,
and architecture reviews.
Design and implement scalable Lakehouse architectures and data platforms across Azure and
AWS cloud environments.
Lead the development of high-performance ETL/ELT pipelines supporting both batch and
real-time data processing workloads.
Drive best practices around coding standards, architecture governance, version control, CI/CD
implementation, and operational excellence.
Architect and optimize Databricks Workflows, Job Clusters, Delta Tables, and Spark
applications to maximize performance and minimize infrastructure costs.
Implement data governance frameworks using Unity Catalog, ensuring proper access controls,
lineage tracking, metadata management, and compliance standards.
Mentor and guide junior and mid-level data engineers through code reviews, technical
coaching, and knowledge-sharing initiatives.
Lead technical teams and coordinate project activities to ensure timely and successful project
delivery.
Collaborate with Data Scientists, BI Teams, and Analytics stakeholders to enable advanced
analytics and machine learning use cases.
Drive automation initiatives through Infrastructure as Code (IaC), DevOps practices, and
CI/CD pipelines.
Establish monitoring, observability, and performance tracking frameworks for data platforms
and pipelines.
Ensure security, compliance, data quality, and operational reliability across enterprise data
ecosystems.
Prepare and maintain technical architecture documents, design specifications, implementation
guides, and operational runbooks.
Requirements
8+ years of experience in Data Engineering, Big Data, and Analytics platforms.
Minimum 5+ years of hands-on experience working with Databricks, Apache Spark, PySpark,
and SQL.
Strong expertise in designing and implementing enterprise-scale Data Lake, Lakehouse, and
Data Warehouse solutions.
Deep understanding of Spark internals, cluster management, performance tuning, partitioning
strategies, and resource optimization.
Extensive experience working with Delta Lake, schema evolution, ACID transactions, and
large-scale distributed data processing.
Hands-on experience integrating Databricks with Azure (ADF, Synapse) and/or AWS (S3,
Glue, Lambda) services.
Proven experience handling end-to-end project delivery and managing technical engagements
with clients and stakeholders.
Experience leading development teams and mentoring engineers in enterprise environments.
Strong understanding of data modeling, dimensional modeling, Medallion Architecture, and
modern data platform design principles.
Expertise in implementing CI/CD pipelines, DevOps practices, and automated deployment
strategies.
Experience with Unity Catalog or equivalent governance platforms.
Excellent communication, stakeholder management, presentation, and client-facing skills.
Ability to lead technical discussions, architecture reviews, and solution design workshops.
Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a
related field.
Information Security & ISO 27001 Compliance
Security is at the heart of everything we do. In this role, you will be strictly required to uphold our Information Security Management System (ISMS) policies in alignment with ISO/IEC 27001 standards. Responsibilities include safeguarding sensitive asset data, completing mandatory security awareness training, reporting potential security incidents or vulnerabilities immediately, and ensuring that daily operations comply with our rigorous data protection protocols.
Listed on hirly, a job board. hirly is not the employer: DATABEAT is hiring for this role.
Similar jobs
- ETL Azure Databricks Engineer - Senior ConsultantWinfo Solutions · Hyderabad, IndiaFirst seen 54d ago
- Senior Databricks Engineer - AI & Data PlatformVantiva · Chennai, Tamil Nadu, IndiaFirst seen 9d ago
- Sr. Databricks EngineerEXL · Bengaluru, Karnataka, IndiaFirst seen 32d ago
- Sr. Databricks EngineerEXL · Pune, Maharashtra, IndiaFirst seen 40d ago
- Databricks EngineerTrigent Software Private Limited · Richmond Town, Bangalore, Karnataka, IndiaFirst seen 17d ago
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job