MakerMaker
INFERENCE ENGINEER
San Francisco
hirly Pro
Get in front of the people hiring at MakerMaker
- Reach the hiring manager at MakerMaker on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at MakerMaker, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Seniority
- Mid level
- Country
- US
- Work mode
- On-site / unstated
- First seen by hirly
- 28 Sept 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
ABOUT THE COMPANY
We're building autonomous research agents for recursive self-improvement (multi-agent systems that propose, run, and analyze machine learning experiments). We're a small, well-funded team that works onsite in San Francisco.
ABOUT THE ROLE
You build and operate the inference systems that serve our models in production. The work spans serving infrastructure, runtime optimization, and the long tail of production infrastructure that come with running real workloads.
This is an engineering role, not a research role. You'll measure, profile, debug, and ship. You'll work alongside researchers, but your job is to make their work fast and reliable in production. Real ownership, real autonomy.
WHAT YOU'LL DO
Build, operate, and harden production inference systems serving large models at high throughput
Own the performance characteristics of those systems end-to-end: throughput, latency, cost-per-token, reliability under load
Profile real workloads to identify bottlenecks; ship fixes that move the metric you set out to improve
Implement and integrate inference optimizations from the research team (quantization, custom kernels, scheduling improvements, memory management) into production
Design observability into the inference layer: metrics, tracing, alerting that surface regressions before users notice them
Run capacity planning, autoscaling, and load testing for varied workload shapes (batch, online, mixed, agentic)
Diagnose and resolve production incidents; write postmortems that turn bugs into systemic fixes
WHAT WE'RE LOOKING FOR
Senior ML systems engineer with 3+ years building production-grade, large-scale serving infrastructure
Strong distributed systems experience ; you've been on-call for systems that matter
Performance profiling and optimization fluency: you read flame graphs, you are analytical and measured before you change
Experience with GPU-accelerated inference at scale (multi-GPU, multi-node, batched and streaming workloads), preferably experience with AMD GPUs
Fluent Python; comfortable reading and writing systems-level code in at least one of the following languages: C++,CUDA, ROCm or Triton
Track record of shipping production infrastructure, preferably surfaces serving millions of requests across diverse workloads
Good written communication; you can write a runbook that someone else can follow at 3am
NICE TO HAVE
Open-source contributions to inference / serving frameworks
Experience with mixed cloud and on-premises deployments
Familiarity with hardware-aware optimization (memory hierarchy, NCCL/RDMA, NUMA)
Background in compilers, runtimes, or accelerator software stacks
THIS ROLE IS PROBABLY NOT FOR YOU IF
You're primarily a researcher, the work here is building, not exploring
You want to focus narrowly on one component; this role spans the stack
Production responsibility (incidents, on-call, ownership of running systems) isn't appealing
Listed on hirly, a job board. hirly is not the employer: MakerMaker is hiring for this role.
Similar jobs
- Distributed Training and Inference EngineerSciforium · San Francisco, CAFirst seen 10d ago
- Inference EngineerAdaption · San FranciscoFirst seen 42d ago
- Distributed LLM Inference EngineerAnyscale · San FranciscoFirst seen 75d ago
- AI Inference EngineerBaseten · San FranciscoFirst seen 75d ago
- Staff Applied AI Inference EngineerCrusoe · San Francisco, CA - USFirst seen 10d ago
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job