hirly

Vals AI

Member of Technical Staff - Research, AI Safety

San Francisco

hirly Pro

Get in front of the people hiring at Vals AI

  • Reach the hiring manager at Vals AI on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Vals AI, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Vals AI first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.1M live jobs from 220,000+ employers in 190+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Lead / management
Stated salary
$130,000 – $185,000 per year
Country
US
Work mode
On-site / unstated
First seen by hirly
21 Oct 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

Note: This is an application for those specifically interested in building benchmarks to assess AI safety. If you are interested in other domains, please see our general research posting . We encourage you to only apply to one research posting.

AI Policy on applications:

We ask that you not submit your application with the assistance of AI. Applications that we suspect of being authored with AI will be rejected.

About the role

We are looking for an exceptional researcher to design and build the next generation of AI benchmarks for catching misaligned behavior in frontier models and agents, e.g., reward hacking, scheming, deception, loss of control, multi-agent safety, etc. You will create high-impact, challenging evaluations that push the boundaries of what we can measure in foundation models. This role is ideal for someone with deep research expertise who wants to see their work directly influence how the world evaluates AI systems.

You will lead the design and development of novel benchmarks and infrastructure that help assess misalignment risks in LLMs. Our benchmarks shape how foundation models are developed and generative AI applications are built. We work with every major foundation model lab - along with leading financial institutions and the application-layer companies pushing the frontier forward. Our work has been featured by the Wall Street Journal, New York Times, Washington Post, and Bloomberg.

We are building the standard for evaluating the ability of LLMs to perform real-world tasks. You will be at the forefront of defining what that standard looks like.

What you'll do

Design and develop novel, high-impact benchmarks and environments that assess real-world (mis)behavior, including reward hacking, scheming, deception and other misaligned behavior, in frontier models and agents (including multi-agent systems)

Conduct research to ensure our benchmarks are valid, reliable, and meaningful

Collaborate with foundation model labs and enterprises to understand evolving safety evaluation needs

Analyze model behavior across benchmarks and articulate results

Publish research findings and contribute to the broader safety and evaluation research communities

Stay current with the latest developments in LLM capabilities and alignment evaluation methodologies

Preferred Qualifications

Safety experience: Substantial, hands-on work in safety evaluations, monitorability, scheming, deception, or multi-agent safety. You may have worked on an AI safety or alignment team, or done a PhD focused on AI safety. You've published safety research, perhaps papers at leading conferences, or high-quality write-ups.

Deep ML/AI background: An understanding of neural networks and the fundamentals behind the model training process.

Strong engineering: Excellent coding skills and the ability to design and build complex evaluation environments yourself, mostly in Python.

Communication : Ability to clearly communicate complex research ideas to both technical and non-technical audiences.

Location: We are an in-person team in San Francisco and will support relocation or transportation as needed.

Nice to haves

Mechanistic interpretability experience

Contributions to open-source safety or evaluation tools and datasets

What we offer

Highly competitive salary and meaningful ownership. Excellence is well rewarded.

Relocation and transportation support

Health/dental insurance coverage

Lunch and dinner provided, free snacks/coffee/drinks

Unlimited PTO

$1,500 housing stipend (within one-mile radius)

Collaborate with leading AI labs and work on the front lines of AI development and evaluations

Opportunity to publish and present your work

About us

Founding team : The core methodology behind this platform comes from NLP evaluation research we conducted at Stanford. We raised a $5M seed from some of the top institutional and angel investors in the valley. Our team has prior work experience at NVIDIA, Meta, Microsoft, Palantir and HRT. Collectively, we have over 300 citations in our published work. Our early team includes Stanford PhDs, ex-Jane Street quants, and the first designer at Snorkel.

We recently announced our $40M Series A at a $400M valuation, led by Andreessen Horowitz , with participation from existing investors 8VC , Pear VC , and Bloomberg and new investors Hudson River Trading and NextLadder Ventures .

Tech stack : We use Python for most things at Vals AI. Our platform is built on Django, with a React frontend. All of the infra is on AWS using CDK for IaC.

What We're Looking For

Learning velocity: The role encompasses a wide variety of tasks. Rather than expecting you to be an expert on Day 1, we are looking for someone who can learn new skills and technologies quickly.

Ownership : Working in a small, talent-dense team, we expect everyone to show initiative to build where it's needed, not where it's asked. We strive for autonomy over consensus.

Intensity : The LLM landscape is constantly changing. Foundation model labs are continuously pushing the frontier. The unicorn companies that will emerge from this technology shift are being built now. Those that win will have an incredibly high speed of execution.

Solution-oriented mindset : We're looking for people who see opportunities to craft solutions at each juncture, not those who pass hard problems to others or admit defeat.

Vals in the Media:

AI tools mostly fumble basic financial tasks, study finds

The Winners (and Losers) of This New Vibe-Coding Benchmark Will Surprise You

OpenAI’s Less-Flashy Rival Might Have a Better Business Model

Meta Announces New AI Model in Major Test of Company’s Ambitions

DeepSeek’s Sequel Set to Extend China’s Reach in Open-Source A.I.

Original posting on Vals AI's site ↗

Listed on hirly, a job board. hirly is not the employer: Vals AI is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job