Technical Product Manager, Infrastructure

About Us

Vast.ai's cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.

We are a growing and highly motivated team dedicated to an ambitious technical plan. Our structure is flat, our ambitions are out-sized, and leadership is earned by shipping excellence.

About the Role

Vast.ai is seeking a Technical Product Manager to drive the backend our GPU cloud marketplace runs on. This is the software behind every live GPU rental (over 700k transactions a month): the daemon on every host's machines, the orchestration that powers each instance, and the infrastructure and test systems that let us ship it all at high velocity.

The Scale: With over 20k GPUs, our AI cloud platform powers thousands of bleeding-edge training runs and critical production workloads for 120k+ developers all over the planet. This is a product with real scale, real data, and real users from day one. The work you ship moves tangible revenue in weeks, not quarters.

The Challenge: We don't own the GPUs. Thousands of independent hosts price and operate them, and no two machines are alike. Your job is to make that heterogeneous, decentralized supply behave like the top-tier cloud our customers expect: fast, secure, and reliable.

What You'll Own

You'll drive the infrastructure, security, and reliability roadmap: sequencing competing priorities, turning non-functional requirements into specs engineering can build, and seeing them through until they ship. You'll own the metrics that prove it worked: platform uptime, fleet reliability, cost-to-serve. Initial focus areas:

Scalability & performance. Keep the core systems fast and ahead of demand as the marketplace grows, from database performance to end-to-end latency.

Security, trust & compliance. Harden the platform against attacks and abuse, and build the compliance roadmap enterprise customers need.

Observability & infra tooling. Give every engineer a clear view of platform health, and every host a clear view of their fleet. Own the metrics, tracing, and tooling behind it.

Ideal Experience

3+ years as a backend engineer AND 3+ years in product management

Hands-on experience with several of: security, scalability, reliability at scale, infrastructure tooling, distributed systems, observability, abuse/fraud prevention, compliance

Industry experience in one or more of the following areas: software infrastructure, developer tooling (APIs, SDKs, CLIs), AI/ML, cloud computing, GPUs, or two-sided marketplaces

Experience at a fast-paced startup or rapid-growth team

You Are

AI-native. You work with AI agents every day, and you want to build the compute layer the AI era runs on.

Deeply technical. You came up as an engineer, and you reason about scalability, security, and efficiency as product concerns, not afterthoughts.

Persuasive across the stack. You can make a technical tradeoff legible to c-suite and a thankless migration compelling to the team doing it.

Biased toward action. You'd rather ship the fix today than present the plan next week.

Tech Stack

Python, C++, SQL/PostgreSQL, Redis, Linux, Docker, AWS, Terraform, REST APIs, LLMs/AI agents

Interview Process

Initial screening (virtual)

Deep dive on the role and your experience (virtual)

Live product and technical assessment (virtual)

In person panel interview + product and technical assessment (on-site)

Annual Salary Range

$170,000–$240,000 base depending on experience, plus equity. We're profitable, venture-backed, and growing, so the equity is a stake in a real company with a real valuation, not a lottery ticket.

Benefits

Comprehensive health, dental, vision, and life insurance

401(k) with company match

Meaningful early-stage equity

Onsite meals, snacks, and close collaboration with founders/tech leaders

Ambitious, fast-paced startup culture where initiative is rewarded

Ample AI agent budget

LOCATION: On-site at our office in Los Angeles (Westwood).