LM Studio
Software Engineer, Inference Runtime
New York City
hirly Pro
Get in front of the people hiring at LM Studio
- Reach the hiring manager at LM Studio on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at LM Studio, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Role family
- Engineering
- Seniority
- Mid level
- Stated salary
- $150,000 – $350,000 per year
- Country
- US
- Work mode
- On-site / unstated
- First seen by hirly
- 1 Sept 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
LM Studio is used by millions of people around the world to run AI on their own computers, and now with Bionic - also in the cloud. Our values prioritize putting the human in the center, and creating tools that we want to use ourselves, and recommend to our friends and family.
As a team, we work with high technical intensity and personal responsibility. We are looking for curious, self-motivated, creative, and technically excellent teammates to join us and build the future of human-AI interactions in software.
The Role
We are looking for an Inference Runtime Software Engineer to push forward LM Studio's inference stack on-device and in the cloud. You will integrate new inference engines and runtime capabilities, bring up new open-weight models and modalities, and optimize model execution for a wide range of CPU and GPU targets. You will also contribute improvements to the open-source projects we build on.
Qualifications
Significant experience building production ML systems, inference runtimes, or performance-sensitive infrastructure
Strong programming ability in Python and C++
Deep understanding of transformer architectures and the mechanics of model inference
Experience profiling CPU or GPU workloads and reasoning about compute, memory, synchronization, and data movement
Experience with PyTorch and inference systems such as llama.cpp, MLX, ExecuTorch, vLLM, SGLang, or TensorRT-LLM
Strong debugging instincts across model code, runtime internals, operating systems, and CPU or GPU execution
Takes personal responsibility for the correctness and performance of their work
Bonus Qualifications
Past contributions to open-source inference runtime projects such as llama.cpp, MLX, ExecuTorch, vLLM, SGLang, or TensorRT-LLM
Responsibilities
Maintain and push forward our inference stack on-device and in the cloud
Bring up new model architectures and multimodal models
Improve latency, throughput, memory use, and reliability across CPU, CUDA, Metal, Vulkan, and ROCm runtimes
Build runtime capabilities for model loading, batching, scheduling, caching, and distributed execution
Benchmark and diagnose correctness and performance problems across the inference stack
Contribute upstream to open-source projects such as llama.cpp and MLX
Benefits
Competitive salary and equity grants
Great medical, vision, dental healthcare plans
Catered team lunch / expensed dinners in the office
Flexible PTO
Flexible WFH
Sun-drenched office in SoHo in NYC
Listed on hirly, a job board. hirly is not the employer: LM Studio is hiring for this role.
Similar jobs
- Software Engineer IVsg · Tampa Bay LightningFirst seen 5d ago
- Software Engineer IIUnum · 2 LocationsFirst seen 5d ago
- Embedded Software EngineerMotorolasolutions · Irvine, CAFirst seen 5d ago
- 2027 Associate Software Engineer - Pathways - Boulder CONgc · United States-Colorado-BoulderFirst seen 5d ago
- 2027 Associate Software Engineer - Pathways - Colorado SpringsNgc · United States-Colorado-Colorado SpringsFirst seen 5d ago
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job