hirly

Ellipsis Health

Senior Backend Engineer, Infrastructure

San Francisco - Hybrid

hirly Pro

Get in front of the people hiring at Ellipsis Health

  • Reach the hiring manager at Ellipsis Health on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Ellipsis Health, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Ellipsis Health first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.9M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Role family
Engineering
Seniority
Senior
Stated salary
$160,000 – $250,000 per year
Country
US
Work mode
On-site / unstated
First seen by hirly
28 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing challenges and administrative burdens using conversational AI and our patented vocal biomarker technology, helping deliver better healthcare experiences for clients and patients. We are headquartered in Silicon Valley and are funded and supported by preeminent venture capital groups and healthcare institutions.

In this role, you will be a core contributor on our AI Research & Engineering team, building the real-time voice infrastructure behind our conversational AI products. You will design and run the Python micro-services that power live voice conversations, from audio capture and streaming transcription to LLM logic, synthesis, and playback. You will work with ML, product, data engineering, and client-SDK teams to deliver secure, low-latency, HIPAA-compliant clinical applications.

Responsibilities:

Real-Time Voice Pipeline: Expand and maintain our real-time voice pipeline by designing, implementing, and maintaining Python micro-services for conversational AI orchestration, including audio capture, streaming transcription, prompt/LLM logic, synthesis, and playback.

Providers, Transports & APIs: Integrate new providers and transports by adding plug-ins for emerging ASR, TTS, LLM, and memory services; wiring up WebRTC, SIP, or phone endpoints; and building adapters that allow hot-swapping components without downtime. Build API endpoints.

Ultra-Low Latency: Deliver sub-500 ms round-trip latency by profiling async pipelines (asyncio, FastAPI, gRPC) and optimizing buffering, concurrency, and back-pressure handling.

Observability: Instrument and observe every hop by emitting structured traces (OpenTelemetry), metrics, and logs for each pipeline stage, and define SLOs for first-token latency, end-to-end latency, and streaming reliability.

Production Hardening: Implement graceful retries, idempotent message passing, circuit breakers, and HIPAA-compliant security (encryption in transit, per-tenant isolation, secrets rotation).

Cross-Functional Collaboration: Work with ML, product, data engineering, and client-SDK teams to deliver features such as voice cloning, multimodal hand-offs, and domain-specific memory retrieval.

Minimum Qualifications:

4+ years building production back-ends in modern Python.

Proven experience with real-time streaming systems (WebRTC, WebSockets, or gRPC streaming) and proficiency with asyncio, FastAPI, or similar async frameworks.

Deep understanding of concurrency, buffering, audio codecs (Opus, PCM), and distributed tracing.

Solid understanding of AWS/GCP/Azure, including container orchestration (Kubernetes/EKS/GKE), message queues (Kafka/SQS/Pub/Sub), and IaC (Terraform).

Solid grasp of relational (PostgreSQL) and in-memory (Redis) data stores, with the ability to model and persist conversational state.

Excellent communication skills and a bias for measured, observable, and continuously deployable software.

Preferred Qualifications:

B.S./M.S. in Computer Science, Electrical Engineering, or a related field.

Familiarity with voice-agent frameworks.

Hands-on experience with telephony (Twilio, Telnyx), SIP, or PSTN integrations.

Experience integrating multimodal inputs (vision, text chat) into voice agents.

Familiarity with GPU inference and streaming pipelines.

Prior work in regulated industries (healthcare, finance) and comfort preparing for SOC 2 / HIPAA audits.

  • Salary and Benefits:
  • We offer competitive salary and benefits, including 401(k) matching, health, vision, and dental insurance, and very flexible paid time off.

The typical salary range for this role is $160,000 to $250,000 USD , depending on skills, qualifications, and relevant experience.

  • Background Checks:
  • As a health technology company, we reserve the right to run background checks on candidates to whom we extend offers, in compliance with applicable laws. We evaluate candidates holistically and comply with all “ban the box” regulations.
  • Assistance:
  • If you have a disability or require accommodations during the application or recruitment process, please contact [email protected] .
Original posting on Ellipsis Health's site ↗

Listed on hirly, a job board. hirly is not the employer: Ellipsis Health is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job