AI Response Quality Evaluator

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Response Quality Evaluator based in Australia.

• As an AI Response Quality Evaluator, you’ll help improve the quality and usefulness of AI-generated responses by assessing how well they understand and respond to personalized user context.
• You’ll review responses generated from personalized prompts and information retrieved through connected Google applications.
• Your work will focus on relevance, accuracy, contextual understanding, personalization, and the overall quality of the user experience.
• You’ll identify subtle issues such as incorrect assumptions, irrelevant recommendations, inconsistencies, and inappropriate personalization.
• The role requires careful analysis and strong written communication to turn observations into clear, actionable feedback for AI model improvement.
• You’ll work independently in a remote environment while following detailed evaluation guidelines and maintaining strict confidentiality.
• This is a project-based opportunity for someone who enjoys analyzing nuanced AI outputs and contributing to the development of more helpful and context-aware AI systems.