hirly

Agency

Audio Specialist- Freelance AI Trainer Project

World Wide - Remote

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Agency first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.5M live jobs from 200,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending. ChatGPT: manual setup today.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Mid level
Work mode
Remote-friendly
First seen by hirly
3 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

  • A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.
  • Responsibilities

Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:

Flight bookings and travel support

Financial services

Telecommunications and technical support

Contribute to the development of diverse and representative datasets used to assess conversational audio agents.

Evaluate model performance across a standardized set of qualitative and quantitative metrics.

Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.

  • Evaluation Metrics
  • Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:

Task completion accuracy and efficiency

Conversational naturalness (tone, flow, and coherence)

Audio comprehension and response quality

Instruction adherence and contextual understanding

Basic computer programming literacy , including:

Understanding of JSON structures

Familiarity with functions and methods

Ability to reason about structured data and simple logic

Technical communication clarity when handling support-style problem-solving

Technical & Equipment Requirements

Strong verbal communication skills in a simulated customer support context

English proficiency including fluency across all language skills: reading, listening, writing, and speaking.

Access to a high-quality microphone to ensure clean, reliable audio input during evaluations

Comfort working with structured prompts, evaluation rubrics, and technical guidelines

Device capable of running audio recording software and opening large technical documentation

We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

  • Employment type: Contract
  • Workplace type: Remote
  • Seniority level: Mid‑Senior Level
Original posting on Agency's site ↗

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job