hirly

Anyone AI

Platform Engineer, RL & Eval Data | 100% remote

Argentina - Fully Remote

hirly Pro

Get in front of the people hiring at Anyone AI

  • Reach the hiring manager at Anyone AI on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Anyone AI, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Anyone AI first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.9M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Role family
Engineering
Seniority
Mid level
Country
AR
Work mode
Remote-friendly
First seen by hirly
17 Nov 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

About the team

The Human Data Division builds training and evaluation data for frontier AI labs: RL environments, coding and STEM evaluation tasks, and expert-annotated datasets. We are a small team that moves fast and holds a high quality bar.

The role

We have built our own evaluation, RL and annotation platforms, and they are already in use. We are looking for a platform engineer to join the platform team as a core member and play a central part in their next stage: keeping them running, making them faster and more reliable, and building the features the team and our clients need next.

You will work across all of these systems and get to know them in depth. You will work closely with the people who write our tasks, review our data and work with the labs, and help turn what they need into working software.

Responsibilities

Maintain and improve the platforms. Learn the existing codebases in depth and keep them healthy in production: fix bugs, pay down technical debt, improve test coverage and documentation.

Build new features. Design and ship new capabilities across the stack, from the database and backend to the APIs and internal tools.

Scale the systems. Grow the platforms from today's volume to much larger workloads, with predictable performance and cost.

Build RL environments and their infrastructure. Build environments that agents act in, and the infrastructure that runs them at scale: sandboxes, environment images, rollouts and reward computation.

Keep everything reliable and secure. Monitoring, alerting, incident response, access control, safe handling of untrusted code and protection of client data.

Support the data teams. Build the tooling that task authors, reviewers and project leads use every day, and help produce fast-turnaround samples when a project needs them.

Skills we are looking for:

Software engineering

Strong backend engineering in Python: clean, tested, maintainable code.

Designing and building APIs and the data models behind them.

Relational databases (Postgres or similar): schema design, migrations, query performance.

Enough frontend skill (TypeScript and React) to build and maintain internal tools.

Comfort joining a codebase someone else wrote, understanding it quickly and improving it without breaking it.

Large-scale system design

Designing distributed systems that run many long-running jobs at once.

Job orchestration, workflow engines and queues: retries, idempotency, failure recovery.

Containers and container orchestration (Docker, Kubernetes or similar), and at least one major cloud provider.

Observability: logging, metrics, tracing and alerting.

Security fundamentals: secrets management, isolation, access control.

RL environments and sandbox infrastructure

Hands-on experience building RL environments for LLM agents: tool interfaces, stateful environments that can be seeded, reset and snapshotted, and reward computed from the final state or the agent's answer.

Running agent code in isolated sandboxes at scale, with sandbox platforms such as Daytona, E2B or Modal, or with your own isolation layer (gVisor, Firecracker microVMs or similar).

Building and caching environment images so that thousands of sandboxes can start quickly and reproducibly.

High-throughput rollout collection: many parallel episodes, timeouts, resource limits, and full logs and trajectories for every episode.

Feeding rollouts and rewards into RL post-training pipelines.

Evaluation

Hands-on experience building or running evaluation harnesses or benchmarks for LLMs or LLM agents.

Writing verifiers, graders or reward functions, and knowing how they fail.

Understanding of how frontier models are evaluated: pass rates, pass@k, headroom, discrimination, reward hacking, and what makes a task hard for a frontier model.

Working with LLM provider APIs and tracking model cost and usage.

Data annotation and human data

Experience building annotation, labeling or human-data tooling.

Contributor and reviewer workflows, quality control and calibration.

Turning a manual, ad-hoc process into a scaled, measured one.

Ways of working

Daily, careful use of AI coding agents: you move fast with them and review their output with the same rigor as a colleague's.

Thrives in ambiguity and ships fast; works independently and takes initiative on a small team.

Clear written communication with both engineers and non-engineers.

Qualifications

5+ years in software, data or ML engineering, with recent work in AI/ML data, model evaluation, annotation or developer tooling.

A track record of running and maintaining production systems, not only building them.

Fluent English.

Nice to have

Contributions to open-source evaluation or RL frameworks.

Experience building tools for a large distributed contributor workforce.

Original posting on Anyone AI's site ↗

Listed on hirly, a job board. hirly is not the employer: Anyone AI is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job