hirly

Inferact

Member of Technical Staff, Exceptional Generalist (Remote)

Remote

hirly Pro

Get in front of the people hiring at Inferact

  • Reach the hiring manager at Inferact on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Inferact, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Inferact first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.1M live jobs from 220,000+ employers in 190+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Lead / management
Country
US
Work mode
Remote-friendly
First seen by hirly
1 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

About the Role

This is a globally remote opportunity. We're seeking exceptional generalist engineers who can work across the entire vLLM stack: from low-level GPU kernels to high-level distributed systems. This role is designed for self-directed, autonomous individuals who can identify the highest-leverage problems and solve them end-to-end without constant guidance.

You'll work asynchronously with our San Francisco headquarters while maintaining full ownership of critical infrastructure. You might be optimizing CUDA kernels one week, designing distributed orchestration systems the next, and implementing new model architectures the week after. The work you do will directly impact how the world runs AI inference.

Potential focus areas include:

Inference Runtime: Push the boundaries of LLM and diffusion model serving. Work at the core of vLLM to optimize how models execute across diverse hardware and architectures.

Kernel Engineering: Write the low-level kernels and optimizations that make vLLM the fastest inference engine in the world, running on hundreds of accelerator types.

Performance & Scale: Build the distributed systems that power inference at global scale—design foundational layers enabling vLLM to serve models across thousands of accelerators with minimal latency.

Cloud Orchestration: Build the operational backbone for cluster management, deployment automation, and production monitoring that enables teams worldwide to serve AI models without friction.

What We're Looking For

We're looking for engineers who thrive with autonomy. You should be able to take a vague problem statement and turn it into shipped code with minimal supervision. You communicate proactively, over-communicate context across time zones, and know when to ask for help versus when to push forward independently.

Core Requirements:

Bachelor's degree or equivalent experience in computer science, engineering, or similar

Demonstrated ability to work autonomously and drive projects to completion without close supervision

Excellent asynchronous communication skills and ability to collaborate effectively across time zones

Strong track record of shipping high-impact work in complex technical environments

Deep expertise in at least one of: systems programming, GPU/accelerator programming, distributed systems, or ML infrastructure

Technical Depth (strong in at least two):

CUDA kernels or equivalent (Triton, TileLang, Pallas) with deep understanding of GPU architecture

High-performance distributed systems in Rust, Go, or C++

Python with PyTorch internals and LLM inference systems (vLLM, TensorRT-LLM, SGLang)

Kubernetes, container orchestration, and infrastructure-as-code at scale

Transformer architectures, KV-cache memory management, and model serving

Preferred Qualifications:

Contributions to vLLM or other major open-source ML/systems projects

Experience with multiple accelerator platforms (NVIDIA, AMD, TPU, Intel)

Knowledge of quantization techniques, ML-specific kernel optimization, or compiler technologies

Track record of improving system reliability and performance at scale

Written widely-shared technical blogs or impactful side projects in the ML infrastructure space

Logistics

Location: Fully remote, worldwide. We're timezone-flexible but expect regular overlap with Pacific Time for critical syncs.

Compensation: We offer competitive compensations (salary + equity) compared to the local market conditions.

Visa sponsorship: We sponsor visas on a case-by-case basis.

Benefits: Inferact offers competitive benefits appropriate to your location, including health coverage where applicable.

Original posting on Inferact's site ↗

Listed on hirly, a job board. hirly is not the employer: Inferact is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job