hirly

Handshake

Member of Technical Staff, Coding Agents

San Francisco, CA · Remote (USA) · New York, NY · Mountain View, CA

hirly Pro

Get in front of the people hiring at Handshake

  • Reach the hiring manager at Handshake on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Handshake, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Handshake first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Lead / management
Stated salary
$200,000 – $350,000 per year
Country
US
Work mode
On-site / unstated
First seen by hirly
9 Oct 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

About Handshake

Handshake's mission is to organize expert human knowledge to advance the AI economy. Handshake AI works directly with frontier labs on their most consequential data, evaluation, and post-training challenges, building the systems that turn expert human knowledge into the data and evaluations that make frontier models better.

You will work alongside engineers, researchers, operators, and builders from organizations including Scale AI, Meta, Google, Amazon, xAI, Notion, and Palantir—and help build the systems that make expert human knowledge useful for advancing AI.

The Role

We are hiring a Member of Technical Staff to help define how frontier coding agents are benchmarked and improved. This is a broad, high-ownership role for researchers who build.

You will partner with the world’s top AI researchers and thousands of software engineers to develop new benchmarks, reward and verifier systems, agent-evaluation methodologies, and data-quality techniques, centered around applications of AI for Coding. You will work on questions at the center of frontier AI progress: what should be measured, how to design evaluations that reflect real capability, how to create high-signal feedback, and how to build the environments and data systems that make those answers actionable.

Early members of the team will have unusual influence over our technical direction, operating culture, and the open-source software, benchmarks, and research products we build. We care more about demonstrated research capability, technical judgment, and a builder's mindset than a specific title, degree, or career path.

Location: San Francisco preferred; we are open to exceptional candidates in other locations.

What you'll do

Create/publish Coding benchmarks that challenge state-of-the-art frontier agents.

Understand/shape the frontier of coding agents and where the space is headed, publishing studies of interesting/impactful findings.

Help the world’s top AI Labs improve their models for coding.

Publicly contribute to the field through benchmarks, open-source tools, research, and technical writing.

What we're looking for

You’re extremely passionate about building software with agents, and regularly tinkering with the latest coding agents.

Comfort operating in an ambiguous, fast-moving environment with substantial ownership.

At least one of the following:

Previous experience working on a Coding benchmark.

Published research on AI for Software / Code-Generation at NeurIPS, ICLR, ICML, COLM, etc.

Extensive software engineering experience or strong GitHub profile of OSS contributions, along with deep knowledge of agent harnesses.

Why join

Work at the very frontier of AI with most major AI labs, researching some of the most important problems in Data and Evaluations.

Publish results and work in public through open-source benchmarks and software, papers, and blogs.

Join a rapidly growing company whose data business grew from zero to nearly $1B run rate in a year.

Help build an early technical organization where your work shapes the roadmap, standards, and culture.

Attend (and publish at) conferences like NeurIPS, ICML, ICLR, COLM.

Perks

Handshake delivers benefits that help you feel supported—and thrive at work and in life.

The below benefits are for full-time US employees.

🎯 Ownership: Equity in a fast-growing company

💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching

🍼 Family Support: Paid parental leave, fertility benefits, parental coaching

💝 Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend

📚 Growth: $2,000 learning stipend, ongoing development

💻 Office: Commuting support, free lunch, and gym in our SF office

🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days

🤝 Connection: Team outings & referral bonuses

Original posting on Handshake's site ↗

Listed on hirly, a job board. hirly is not the employer: Handshake is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job