hirly

Mpathic2

Machine Learning Engineer, Evaluation

Remote

hirly Pro

Get in front of the people hiring at Mpathic2

  • Reach the hiring manager at Mpathic2 on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Mpathic2, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Mpathic2 first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.3M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Role family
Data & ML
Seniority
Mid level
Country
US
Work mode
Remote-friendly
First seen by hirly
20 Nov 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

About mpathic

mpathic builds AI that understands clinical and human conversations: analyzing therapy and clinical-trial sessions, producing expert-labeled data for AI builders, and publishing open safety benchmarks.

About the role

We’re looking for a Machine Learning Engineer to build and improve ML-powered products, with a particular focus on evaluating their quality and reliability. You’ll work across the ML lifecycle, combining hands-on engineering with rigorous experimentation to understand how systems perform and where they need to improve.

This is a generalist ML engineering role with an evaluation focus. You’ll contribute to production systems while helping the team make sound decisions about models, data, and product changes.

What you’ll do

Build, deploy, and maintain ML models and services in collaboration with engineering and product teams.

Design evaluation approaches that reflect product needs and real-world operating conditions.

Create and maintain evaluation datasets, benchmarks, and automated regression tests that measure safety, empathy, and risk.

Select appropriate metrics, analyze performance across meaningful data segments, and investigate failure modes.

Design experiments and use statistical methods to judge whether an improvement is real.

Connect offline evaluation results with what customers see in production.

Develop tools that make evaluation repeatable and useful throughout development and release workflows.

Communicate findings, limitations, and recommendations clearly to clinicians, product leads, and customers.

What you’ll bring

Practical experience developing and shipping ML systems, typically 2–5 years of relevant work or equivalent.

Strong Python skills and familiarity with common ML frameworks.

Solid ML fundamentals, including training, validation, generalization, and common sources of model error.

Experience with evaluation metrics, benchmark design, and systematic error analysis.

An understanding of statistical inference, sampling, confidence intervals, and experimental design.

Experience identifying data leakage, evaluation bias, and gaps in test coverage.

Good software engineering practices, including testing, version control, and code review.

Skill at turning ambiguous product goals into measurable quality criteria.

Helpful additional experience

A/B testing and production performance monitoring.

Human evaluation, annotation guidelines, and inter-rater agreement.

Speech or conversational data: transcripts, diarization and multi-speaker setups.

Evaluating ranking, retrieval, recommendation, or generative AI systems.

Robustness testing, calibration, fairness analysis, or distribution shift detection.

Building evaluation tooling and integrating quality checks into CI/CD workflows.

Clear, direct communication, both written and verbal.

Startups and cross-functional teams.

Original posting on Mpathic2's site ↗

Listed on hirly, a job board. hirly is not the employer: Mpathic2 is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job