hirly

White Circle

Senior Data Labeler

Paris · London

hirly Pro

Get in front of the people hiring at White Circle

  • Reach the hiring manager at White Circle on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at White Circle, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at White Circle first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Senior
Countries
FR, GB
Work mode
On-site / unstated
First seen by hirly
11 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

TL;DR: We're looking for a Data Labeling Lead to build our annotation team from zero – setting quality standards, designing evaluation frameworks, and running the labeling operations behind our safety evals, RLHF, and benchmarks. You'll own quality, throughput, and cost while working side by side with our AI researchers.

About us

White Circle is an AI Safety company building the safety, reliability, and optimization layer for AI systems. At the core of our platform are policies – simple natural-language rules that define what an AI model should and shouldn’t do. We automatically test, enforce, and continuously improve these policies at scale.

We’ve recently raised our Series A funding round, taking our total funding to $70M. Our investors include top funds, founders, and senior leaders at OpenAI, Anthropic, HuggingFace, Mistral, DeepMind, Datadog, Sentry, and others

We process over 100M+ API calls every month

We fine-tune and train our own LLMs so they run faster and cheaper than any open or proprietary model

We’re at a multi-million dollar run rate already having signed customers like Lovable and multiple neobanks. You’ll be joining at the most exciting time - early enough that the equity can be life-changing, but at a point where demand has been proven.

In this role, you will

Build from scratch and lead the Data Labeling team (hiring, coaching, and performance management)

Define annotation guidelines, quality standards, and evaluation frameworks

Develop quality assurance processes, calibration sessions, and auditing systems

Partner with AI researchers and engineers to translate research objectives into labeling workflows

Prioritise labeling projects based on business and research needs

Monitor operational metrics including quality, consistency, throughput, and cost

Improve annotation tooling, automation, and workflow efficiency

Lead complex AI evaluation projects, including safety, preference ranking, RLHF, policy evaluation, and benchmark creation

Analyse disagreement patterns and edge cases to improve guidelines and model performance

Manage vendor relationships and ensure consistent quality across distributed teams

Build reporting dashboards and communicate operational insights to leadership

Foster a culture of continuous improvement, accountability, and operational excellence

We're looking for someone who

Has experience leading data annotation or AI evaluation teams

Has strong operational and people management skills

Understands AI model evaluation, LLM behaviour, and modern annotation workflows

Can design scalable processes without sacrificing quality

Communicates clearly across technical and non-technical teams

Thrives in fast-moving startup environments

You might be a great fit if you

Have managed annotation programs for LLMs, generative AI, or machine learning

Have experience with RLHF, preference data collection, safety evaluations, or benchmark creation

Have worked in Trust & Safety, AI Safety, Content Moderation, or ML Ops

Have managed distributed or global annotation teams

Have experience with vendor management and outsourcing operations

Bonus points

Familiarity with prompt engineering and AI safety policies

SQL, Python, or data analysis experience

Experience building internal annotation platforms or workflow automation

Background in linguistics, cognitive science, machine learning, or data operations

Important note

  • This role involves overseeing projects that may include offensive, harmful, violent, sexual, or otherwise disturbing content.
  • You'll be responsible for ensuring reviewers have the tools, guidance, and support necessary to perform this work safely and consistently.

Compensation & benefits

Competitive compensation, including equity

Flexible time off

A spacious office in the heart of Paris’s 2nd arrondissement, with a flexible hybrid setup

Relocation support if you’re moving to Paris, available after your probationary period

Premium private health insurance

Mental health support, including coverage for therapy when you need it

Language lessons to help you improve your English or French

Lunch and dinner covered when you work from the office

Learning and development support for courses, conferences, and opportunities to grow your skills

All the hardware, subscriptions, tools, and services you need

Team off-sites twice a year: we’ve recently been to the Alps, Saint-Tropez, and Marbella

Process

Intro call (25 min)

Take-home test assignment

Final conversation with CEO (45 min)

Please submit your application in English.

Original posting on White Circle's site ↗

Listed on hirly, a job board. hirly is not the employer: White Circle is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job