hirly

Rhoda AI

Software Engineer, Inference Infrastructure

Mountain View

hirly Pro

Get in front of the people hiring at Rhoda AI

  • Reach the hiring manager at Rhoda AI on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Rhoda AI, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Rhoda AI first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Role family
Engineering
Seniority
Mid level
Stated salary
$175,000 – $280,000 per year
Country
US
Work mode
Remote-friendly
First seen by hirly
1 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

At Rhoda AI, we’re building the next generation of generalist intelligent robots. We own the full robotics stack from high-performance hardware and robot systems to the infrastructure and state-of-the-art foundation world models that control our robots. Our robots are designed to be generalists capable of operating in complex, real-world environments and handling long-tail edge cases, made possible by our cutting edge research and end-to-end system design. We've raised over $450M and are investing aggressively in model research, infrastructure, hardware development, and manufacturing scale-up to make generalist robotics a reality.

We're looking for a Software Engineer to help build and operate the systems that power our model deployment stack. You'll be responsible for running large foundation models efficiently and reliably across cloud and on-prem environments, with a focus on resource management, scheduling, and infrastructure scalability.

What You'll Do

Design and operate large-scale infrastructure to run model workloads across cloud and on-prem environments

Build and maintain Kubernetes-based deployment pipelines for managing distributed ML workloads

Own resource scheduling and orchestration across GPU clusters — optimizing utilization, workload balancing, and cost-performance tradeoffs

Integrate and manage ML frameworks and model serving systems (e.g., Triton, Ray Serve, TorchServe) across research and production use cases

Build tooling for model deployment, versioning, and observability to support fast iteration cycles

Contribute to the reliability and scalability of the infrastructure stack as model complexity and deployment footprint grow

What We're Looking For

3+ years of experience in ML infrastructure, MLOps, or distributed systems

Strong proficiency with Kubernetes and containerized deployment pipelines

Experience with GPU orchestration and resource scheduling across large distributed jobs

Experience with cloud providers (e.g., AWS, GCP) and hybrid cloud/on-prem infrastructure

Familiarity with ML frameworks (e.g., PyTorch, JAX) and model serving tools (e.g., Triton, Ray Serve, TorchServe)

Strong debugging instincts and ownership mentality — comfortable driving issues to resolution across the stack

Nice to Have (But Not Required)

Experience with streaming systems or high-throughput data transport (e.g., Kafka, gRPC, NATS)

Background in networking, low-latency systems, or network-aware scheduling

Experience with edge/cloud hybrid deployment patterns and the latency constraints that come with them

Familiarity with on-robot or embedded inference environments

Experience with large-scale cluster topology and scheduling systems (e.g., SLURM, Ray, Volcano)

Why This Role

Own the infrastructure layer that connects our foundation models to real robot behavior — a direct line between your work and what the robot does in the world

Be part of building the infrastructure stack for one of the most technically ambitious robotics companies in the world

Original posting on Rhoda AI's site ↗

Listed on hirly, a job board. hirly is not the employer: Rhoda AI is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job