hirly

Mpathic2

QA Reviewer & Project Coordinator (On-Site - Seattle or Boston)

Seattle, Washington

hirly Pro

Get in front of the people hiring at Mpathic2

  • Reach the hiring manager at Mpathic2 on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Mpathic2, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Mpathic2 first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.9M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Mid level
Country
US
Work mode
On-site / unstated
First seen by hirly
2 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

About the Role

We're seeking an experienced QA Reviewer & Project Coordinator . This is a hands-on role that combines expert evaluation and quality assurance with day-to-day project coordination. You'll spend most of your time reviewing work, testing AI systems, and ensuring high-quality outputs while also helping keep projects organized, on schedule, and running smoothly.

Position Overview

This position is ideal for someone who enjoys both deep subject matter expertise and operational execution .

You'll serve as one of the primary reviewers for AI safety work, conducting quality reviews, identifying behavioral edge cases, testing AI models through role play and red teaming, and ensuring consistency across projects. In addition, you'll coordinate portions of active programs by tracking deliverables, supporting staffing and project workflows, communicating with stakeholders, and helping identify operational risks before they become issues.

The ideal candidate enjoys solving ambiguous problems, has exceptional attention to detail, communicates clearly, and thrives in a fast-moving startup environment.

What You'll Do

QA & AI Evaluation

Review AI content for accuracy, safety, empathy, and policy compliance.

Conduct quality assurance reviews of expert evaluations and annotations.

Participate in calibration sessions to ensure reviewer consistency and quality.

Help improve QA workflows, reviewer documentation, and operational processes.

Role play realistic clinical scenarios with AI systems to evaluate behavior across diverse situations.

Perform red teaming to identify failure modes, safety risks, and behavioral edge cases.

Develop and refine evaluation rubrics, behavioral taxonomies, personas, and scoring guidelines.

Document model inconsistencies, safety concerns, and opportunities for improvement.

Collaborate with researchers and engineers to improve AI behavior through structured clinical feedback.

Maintain strict confidentiality while working with sensitive clinical content.

Project Coordination

Support day-to-day execution of AI safety and evaluation projects.

Track project timelines, deliverables, and reviewer assignments.

Coordinate review queues and help balance workloads across project teams.

Monitor project progress and proactively identify risks, blockers, or quality issues.

Maintain project trackers, documentation, and reporting dashboards.

Assist with staffing coordination as project needs evolve.

Help facilitate project meetings and document action items and follow-up tasks.

Required Qualifications

Familiarity with ChatGPT, Claude, Gemini, or other large language models.

Excellent written communication and documentation skills.

Strong organizational skills with exceptional attention to detail.

Comfortable managing multiple priorities simultaneously.

Ability to work independently while collaborating effectively across teams.

Comfortable working in a fast-paced startup environment with evolving priorities.

Preferred Qualifications

Experience reviewing or auditing clinical work for quality.

Experience with AI safety, LLM evaluation, prompt engineering, or red teaming.

Background in trust & safety, content moderation, or behavioral policy development.

Experience developing evaluation rubrics, taxonomies, or annotation guidelines.

Familiarity with data annotation or human-in-the-loop evaluation workflows.

Clinical experience working with serious mental illness, crisis intervention, or complex behavioral health populations.

Project coordination or project management experience.

Experience leading calibration sessions or reviewer training.

Experience with Google Workspace, Slack, spreadsheets, and project management tools.

You'll Thrive Here If You...

Notice details that others miss.

Can identify quality issues before they become larger problems.

Enjoy both analytical review work and coordinating people and projects.

Communicate clearly across clinical and operational teams.

Balance independent problem solving with knowing when to escalate.

Thrive in ambiguity and rapidly changing environments.

Care deeply about building AI systems that are safe, trustworthy, and clinically responsible.

Take ownership and consistently follow through.

Additional Requirements

Ability to work on-site at our designated office location (Seattle or Boston).

Willingness to sign comprehensive confidentiality and NDA agreements.

Comfortable working with sensitive mental health and AI safety content.

Participation in recurring project meetings, calibration sessions, and operational planning.

Availability to support occasional high-priority project deadlines as needed, including potential evening and weekend work.

Apply Even If You Don't Check Every Box

We know great candidates might not fit every bullet on a job description. If this role speaks to you and you're excited to help improve the future of healthcare research and AI safety, we'd love to hear from you.

Original posting on Mpathic2's site ↗

Listed on hirly, a job board. hirly is not the employer: Mpathic2 is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job