Together AI
Senior Product Manager, Inference
San Francisco
hirly Pro
Get in front of the people hiring at Together AI
- Reach the hiring manager at Together AI on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at Together AI, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Role family
- Product management
- Seniority
- Lead / management
- Country
- US
- Work mode
- Remote-friendly
- First seen by hirly
- 2 Sept 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
About the Role
Inference is a critical part of Together AI’s vision and growth strategy. Developers and enterprises use Together to run leading open models across coding agents, AI-native applications, enterprise workflows, and large-scale production workloads.
We’re looking for a Senior Product Manager to shape how customers consume and build on Together inference.
As inference becomes a larger part of our business, the product surface is becoming more complex. Workloads span different tenancy, capacity, performance, and modality needs; agentic applications are changing how inference is consumed; and customers increasingly expect deep infrastructure capabilities to translate into predictable, easy-to-use products.
This role owns the product layer between Together’s inference infrastructure and the developers and enterprises consuming it. You’ll help define how our portfolio of inference products fits together, where Together should differentiate, how customers move from experimentation to production, and how the developer experience evolves as workloads become more sophisticated.
This is a hands-on technical product role. You’ll use our APIs and SDKs, study real workloads, test integrations, and work closely with inference platform engineers and researchers to turn infrastructure and model capabilities into clear product decisions and customer experiences.
Responsibilities
Shape the inference product strategy. Define how Together’s portfolio should serve different customer needs across tenancy, capacity, performance, workload patterns, and modalities.
Own the developer experience around inference. Improve our APIs, SDKs, compatibility, and integrations across applications, coding agents, frameworks, and developer tools.
Build for emerging workloads and modalities. Understand how agentic, voice, multimodal, batch, and other workload patterns are changing what customers need from inference infrastructure, and translate those shifts into product direction.
Turn infrastructure and model capabilities into customer-facing products. Work closely with inference platform engineers and researchers to understand capabilities and constraints across performance, routing, caching, reliability, capacity, and model behavior, and translate them into the right abstractions, guarantees, and controls for customers.
Connect product decisions to business outcomes. Shape pricing and packaging alongside Finance and GTM, and use adoption, inference consumption, utilization, unit economics, and customer expansion to prioritize where we invest.
Stay close to customers and the product. Talk with developers and enterprise teams, inspect usage patterns, test workflows yourself, and use that context to form a clear point of view on what we should build and what we should not.
Drive products from idea to production. Partner closely with engineering, research, sales, partnerships, finance, and other teams to make tradeoffs, align around priorities, launch, and iterate.
Requirements
Strong product judgment and the ability to take an ambiguous technical problem, identify what matters, make tradeoffs, and develop a clear point of view.
Meaningful experience building or owning APIs, developer tools, infrastructure, cloud platforms, data systems, AI products, or another technically deep product.
Strong technical depth and curiosity. You can work credibly with engineers and researchers, reason about system behavior and constraints, and go deeper when the product problem requires it.
A hands-on operating style. You’re comfortable testing APIs and SDKs, using developer tools, reading technical documentation or code when useful, and building lightweight prototypes or analyses to sharpen your thinking.
Strong developer and customer empathy. You care about what a system actually feels like to integrate with and operate in production, not just whether the underlying capability exists.
A track record of making clear product decisions and shipping in fast-moving environments where the right answer is not always obvious.
Strong communication and cross-functional leadership, with the ability to earn trust across engineering, research, customers, and business teams.
Experience with LLM inference, model serving, distributed systems, GPU infrastructure, agents, or developer-facing AI products is helpful, but not required. We care most about your ability to learn technical systems quickly, get close to the product, and develop strong judgment.
About Together AI
Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.
Compensation
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250 - 300k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Application Policy
Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy .
Listed on hirly, a job board. hirly is not the employer: Together AI is hiring for this role.
Similar jobs
- Product Manager, GridBaseten · San FranciscoFirst seen 6d ago
- Principal Product Manager, DataFigure · San Francisco, CA; Pittsburgh, PAFirst seen 6d ago
- Operations & Data Product Manager – Applied Research IntelligenceWiley · 3 LocationsFirst seen 5d ago
- Technical Product ManagerWhitecapFirst seen 5d ago
- Senior Digital Product Manager LeadPnc · 6 LocationsFirst seen 5d ago
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job