Agency
Search Engine Evaluation Specialist - Freelance AI Trainer Project
United States of America
hirly Pro
Get in front of the people hiring at Agency
- Reach the hiring manager at Agency on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at Agency, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 3M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Seniority
- Mid level
- Country
- US
- Work mode
- Remote-friendly
- First seen by hirly
- 3 Sept 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
Project Overview
We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly interpret search intent, analyze indexing protocols, and evaluate search rank responses, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training.
Project Deliverables & Scope
Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:
Task & Prompt Creation: Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to search rank response analysis, indexing logic, and query relevance.
Benchmark Evaluation Data Generation: Producing clean, reliable training data that directly aids in the evaluation and refinement of AI models handling complex SEO and search engine ranking tasks.
Quality Assurance & Fact-Checking: Ensuring all generated tasks and scoring criteria reflect strict, real-world search quality rating standards, technical indexing mechanics, and user intent accuracy.
Required Expertise
To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios.
Core skillset includes:
Demonstrable professional expertise within the Search Engine Optimization (SEO), search quality rating, or digital marketing sectors, with a deep understanding of indexing, ranking factors, and search response evaluation.
Strong writing and prompt generation skills, with the ability to design highly realistic, complex search evaluation task scenarios for AI training.
Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation.
A meticulous, detail-oriented approach to fact-checking search rankings, evaluating content quality against official rating guidelines, and generating reliable data for system benchmarking.
We offer a pay rate of $20 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Engagement Type: Freelance / Independent Contractor
Workplace Type: Remote
Listed on hirly, a job board. hirly is not the employer: Agency is hiring for this role.
Similar jobs
- Test & Evaluation SpecialistAgile Defense · Fort Huachuca, AZFirst seen 42d ago
- Impact Evaluation SpecialistImpact Genome · Washington DCFirst seen 45d agoremote
- Merchant Mariner Evaluation Specialist (Deck)U.S. Coast Guard · Juneau, Alaska, United StatesFirst seen 45d ago
- Merchant Mariner Evaluation Specialist (Engine)U.S. Coast Guard · Juneau, Alaska, United StatesFirst seen 45d ago
- Test & Evaluation Specialist IDigital Consultants, LLC · Sierra Vista, AZFirst seen 47d ago
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job