hirly

MakiPeople

AI Research Scientist

Paris · London

hirly Pro

Get in front of the people hiring at MakiPeople

  • Reach the hiring manager at MakiPeople on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at MakiPeople, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at MakiPeople first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.9M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Role family
Data & ML
Seniority
Mid level
Countries
FR, GB
Work mode
On-site / unstated
First seen by hirly
17 Nov 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

About the Science and AI Team

The Science and AI team is at the heart of Maki People. It builds the science and AI behind our platform, from job analysis and assessments to AI interviews and predicting performance. Led by our Head of Science, Aiden Loe, and working closely with our COO, Paul-Louis Caylar, the team brings together business psychologists, psychometricians and AI scientists. Together, they make sure every hiring decision on our platform is accurate, consistent and fair.

As Maki grows, the Science and AI team’s job is to show, with evidence, that our approach leads to better hiring decisions.

About the Role

The AI Research Scientist works at the intersection of AI, psychometrics and research, ensuring that Maki’s automated scoring systems are scientifically robust, fair, and continuously improving.

1. Evaluating and testing LLMs for scoring

Assess the accuracy and reliability of LLMs used for automated scoring, such as structured grids, job-specific skills and multilingual proficiency (written and spoken).

Benchmark closed- and open-source models across assessment types and languages.

Test robustness to prompt variation, input noise and adversarial behaviour such as prompt injection.

Explore prompt engineering and model optimisation, and recommend which models and prompts go into production.

2. Building our own scoring models

Move our scoring onto self-hosted open-weight models, and fine-tune them on expert-rated data where they can beat frontier models.

Check every model switch keeps accuracy, reliability and fairness at least as good as today's.

3. Comparing AI with human judgement, and calibrating psychometric models

Design studies that compare AI scores with expert ratings, against both individual experts and expert averages, to establish agreement and validity.

Develop hybrid scoring pipelines with engineering that combine human oversight with AI scoring.

Evaluate and calibrate psychometric models for validity and comparability across populations and test forms.

4. Bias and fairness analysis

Detect and analyse bias in AI-generated and psychometric scores across demographic groups, including subgroup analysis.

Apply mitigation techniques such as reweighting and calibration without losing model performance.

Contribute to fairness dashboards and compliance documentation that support transparent model governance.

5. Predictive analytics and performance insights

Model the relationship between candidate scores and job performance and retention, using large assessment and performance datasets.

Develop and test models that estimate success probabilities or identify behavioural and linguistic predictors of performance.

Work with data science, implementation and customer success teams to turn findings into recommendations for clients and colleagues.

6. Research output

Publish reports, papers and conference presentations, internal and external.

Explain technical findings clearly to non-technical colleagues and clients.

As one of Maki People's early employees, you'll help shape the team's future.

Our Ideal Candidate

Required

PhD or MSc in machine learning, computational linguistics, data science or psychology.

A track record of publications, such as peer-reviewed papers or conference papers.

Hands-on experience evaluating LLMs: designing benchmarks, measuring agreement with human raters, and testing consistency and robustness of model output.

Experience testing AI-driven decisions for fairness and bias.

Proficiency in Python or R, with experience in statistical analysis.

Clear communication of results to scientific and business audiences.

Preferred

Experience with NLP techniques for automated scoring.

Experience fine-tuning language models, for example with LoRA.

Experience working with cloud databases and large datasets.

Working knowledge of psychometric concepts such as reliability, validity and IRT, and how they apply to assessment design and validation.

Working knowledge of ethical AI, data governance and compliance, such as the EU AI Act.

Experience working with engineering, product and content teams.

Application Process

Stage 1 - Screening assessment (25 min)

Stage 2 - Power skill assessment with our AI agent (15 min)

Stage 3 - Hiring manager interview (45 min)

Stage 4 - Executive interview (45 min)

Stage 5 - Deep-dive technical interview (60 min)

Stage 6 - Interview with Co-founder (30 min)

Original posting on MakiPeople's site ↗

Listed on hirly, a job board. hirly is not the employer: MakiPeople is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job