hirly

Arcanaanalytics

Staff Software Engineer (Data Platform)

Bangalore, Hybrid

hirly Pro

Get in front of the people hiring at Arcanaanalytics

  • Reach the hiring manager at Arcanaanalytics on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Arcanaanalytics, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Arcanaanalytics first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Role family
Engineering
Seniority
Lead / management
Country
IN
Work mode
Remote-friendly
First seen by hirly
3 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

Staff Software Engineer (Data Platform) Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Staff Data Engineer. Embark on a journey where your deep-rooted expertise in distributed systems, data architectures, and large-scale processing becomes the cornerstone of building high-performance data platforms. This pivotal role demands proficiency in designing and scaling compute and I/O-intensive data systems, ensuring reliability, efficiency, and cost optimization across the data lifecycle.

  • Responsibilities:
  • ● Design and build scalable data platform components for batch and real-time data processing. ● Architect, develop, and operationalize large-scale data systems across ingestion, transformation, and serving layers. ● Build and manage robust data pipelines ensuring high reliability, scalability, and cost efficiency. ● Develop reusable frameworks and tooling to accelerate productivity for data engineers and data scientists. ● Leverage expertise in Python, Airflow, SQL, and cloud platforms to build production-grade data solutions. ● Optimize query performance and data models using strong understanding of columnar OLAP systems such as ClickHouse, Doris, and StarRocks. ● Implement streaming and near real-time data processing systems. ● Translate complex business requirements into scalable and efficient data platform solutions. ● Work collaboratively with cross-functional teams and provide technical leadership and mentorship. ● Drive architectural decisions by evaluating tradeoffs and selecting the right tools for the problem.
  • Requirements:
  • ● Bachelor's Degree in Computer Science, Information Technology, or a similar discipline. ● 8+ years of professional experience in data engineering, backend systems, or distributed systems. ● Proven experience building scalable data platforms and large-scale data systems. ● Strong experience with ETL pipelines, data integration, and workflow orchestration systems such as Airflow or Temporal. ● Hands-on experience in Python and SQL with strong understanding of data warehouse concepts. ● Experience working with distributed OLTP/OLAP databases such as ClickHouse, PostgreSQL, Cassandra, or Elasticsearch. ● Knowledge of messaging and streaming systems such as Kafka. ● Experience with cloud platforms (AWS/GCP) and big data tools such as Spark. ● Strong understanding of columnar storage systems and query optimization techniques. ● Solid understanding of distributed systems fundamentals and associated tradeoffs. ● Experience working with containers and orchestration tools such as Docker and Kubernetes. ● Strong Linux fundamentals and system-level debugging skills. ● Familiarity with modern data architectures such as Lakehouse (Iceberg, Hudi, Delta) is a plus.
Original posting on Arcanaanalytics's site ↗

Listed on hirly, a job board. hirly is not the employer: Arcanaanalytics is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job