Senior AI Systems Quality Engineer

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior AI Systems Quality Engineer based in United States.

This role focuses on engineering quality, reliability, and trust into production-grade AI systems used in mission-critical healthcare environments. You will design automated testing frameworks, evaluation pipelines, and scalable quality practices for agentic and LLM-driven applications. The position goes beyond traditional QA, emphasizing quality-by-design, safe failure behavior, measurable evaluation signals, and continuous validation throughout the development lifecycle. You will help build an AI testing platform integrated with Databricks and MLflow to support traceability, lineage, and auditability at scale. Working closely with AI engineering, platform, security, and delivery teams, you will influence release readiness and operational confidence. This is an automation-first engineering opportunity for someone passionate about making advanced AI systems reliable, governed, and production-ready.