Anyone AI
Multilingual Audio Evaluator
Argentina - Fully Remote · Italy · Austria · Portugal · France · Spain · Netherlands · Brazil
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Apply from your AI assistant
Connect hirly to Claude and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending. ChatGPT: manual setup today.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Seniority
- Mid level
- Countries
- AR, IT, AT, PT, FR, ES, NL, BR
- Work mode
- Remote-friendly
- First seen by hirly
- 13 Oct 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
Help shape the future of AI by evaluating how conversational AI agents communicate and perform across different languages.
Location: Remote / Global, subject to project location restrictions
Type: Independent contractor / Project-based
Commitment: To be confirmed
Compensation: To be confirmed
Project duration: 2–3 months
About the role
At Anyone AI, we create high-quality training and evaluation data for frontier AI models.
We’re looking for multilingual audio evaluators with strong spoken-language proficiency and technical literacy to assess conversational AI agents.
In this role, you’ll participate in live, real-time roleplay scenarios, capture session recordings and technical logs, label conversation transcripts, and evaluate interactions using structured rubrics. Your feedback will help improve the quality and reliability of AI conversations across languages.
What you’ll do
Prepare and confirm the required tools and access before each live session.
Conduct live, real-time roleplay scenarios with conversational AI agents.
Capture recordings, session IDs, and tool-call or console logs.
Label conversation transcripts according to project guidelines.
Score interactions against structured evaluation rubrics.
Provide clear written explanations supporting your scores.
Read, validate, and troubleshoot JSON, identifying structural and formatting issues.
What we’re looking for
C1/C2 spoken fluency in at least one of the target languages listed below.
Ability to demonstrate language proficiency through a speaking and listening assessment.
Strong JSON skills , including reading, validation, troubleshooting, and identifying structural or formatting errors.
Comfort using digital tools and collecting recordings and technical logs.
Strong attention to detail and the ability to follow evaluation guidelines consistently.
Clear written communication and sound judgment when assessing AI interactions.
Languages we’re hiring for
Welsh
Dutch
Greek
Italian
French
German
Portuguese
Nice to have
Experience in AI evaluation, audio annotation, or transcript labeling.
A background in technical support, quality assurance, or software development.
Familiarity with conversational AI, APIs, and structured data.
Listed on hirly, a job board. hirly is not the employer: Anyone AI is hiring for this role.
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job