Content Specialist III | AI Evaluation & Prompting

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Content Specialist III | AI Evaluation & Prompting based in United States.

• This remote contract role offers the opportunity to directly influence the quality and behavior of advanced AI systems.
• You’ll evaluate model responses across diverse topics, conversation types, and real-world use cases.
• Your work will help identify strengths, uncover failure patterns, and improve how AI systems communicate with users.
• You’ll combine expert writing, analytical judgment, prompt engineering, and structured quality assessment to shape model performance.
• The role involves close, hands-on experimentation with evolving AI products in a fast-moving environment.
• You’ll translate detailed observations into actionable feedback, stronger prompts, and more effective evaluation frameworks.
• Success requires balancing quality, speed, consistency, and independent judgment while adapting to changing product priorities.