Pluralis Research
Research Scientist - Pre-training
San Francisco · Australia
hirly Pro
Get in front of the people hiring at Pluralis Research
- Reach the hiring manager at Pluralis Research on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at Pluralis Research, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 2.9M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Role family
- Data & ML
- Seniority
- Mid level
- Countries
- US, AU
- Work mode
- Remote-friendly
- First seen by hirly
- 14 Oct 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights ( tech report ). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning .
This setting breaks nearly every assumption of datacenter training: communication-efficient training across different parallelism axes, fault tolerance as nodes join and drop mid-run, heterogeneous compute and networks, and robustness to malicious participants. Our published methods include Subspace Networks , Factored Gossip DiLoCo , AsyncMesh , and Sentinel .
As a Research Scientist you'll build the training system that takes Protocol Learning from the 8B run to frontier scale: large models on heterogeneous hardware, in physically different regions, connected by ordinary internet.
Key Responsibilities
Distributed pretraining : Implement and optimize model-parallel training. Data, pipeline, and tensor parallelism for large models on heterogeneous GPUs under low-bandwidth, high-latency links.
Performance optimization : Implement techniques that reduce communication overhead while maintaining model convergence in challenging network environments.
Elasticity and fault tolerance : Make runs survive node churn. Robust checkpointing, state synchronization, and recovery as participants join and leave.
Run instrumentation : Build the monitoring that shows throughput, bottlenecks, and model quality across hundreds of devices.
What We're Looking For
Hands-on distributed training (required) : You've trained models across many devices in PyTorch with FSDP, DeepSpeed, Megatron, or your own implementation. You understand data, tensor, and pipeline parallelism.
Strong engineering : Production-quality Python. Concurrency, failure handling, profiling before optimizing.
Evidence of execution : Shipped systems, research code, open-source work, or serious personal projects.
Mission alignment : You believe Protocol Learning is the viable third path for collective, trustless, and sovereign AI.
Nice to Have
Hands-on experience training or serving large language models such as Nemotron, Qwen or OLMo.
Experience with P2P networking and NAT traversal.
Experience with post-training and RL.
Experience with inference and serving systems.
Experience at proprietary, open-weight and open-source AI labs
Compensation & Benefits
Equity-Heavy Package : We offer significant ownership for key technical contributors in addition to a high base salary.
Remote-First Culture : Flexible work environment with team members distributed globally.
Visa Sponsorship : Optional full visa sponsorship and relocation support to either Australia or the US.
Open Problems : Training and serving frontier models on hardware you don't control, over networks you don't own, mostly has no published answers yet. You'll write some of the first ones.
FYI's
We work remotely across the world, with the main teams in Australia and North America. You'll need to be comfortable working across timezones.
Applicants must have professional-level English proficiency (written and spoken).
Recruiters: we aren't looking for agency support at this time. We'll reach out if we need help.
We are backed by Union Square Ventures and other tier-1 investors, and we are a world-class, deeply technical team of ML researchers. Pluralis is unapologetically ideological. We believe AI, and the world, end up on a better path if we succeed in implementing the protocol for intelligence. If this resonates, please apply.
Listed on hirly, a job board. hirly is not the employer: Pluralis Research is hiring for this role.
Similar jobs
- Applied Research Scientist, AgentsLumafield · San Francisco, CAFirst seen 7d ago
- Advanced Manufacturing Research ScientistNational Institute of Standards and Technology · Gaithersburg, Maryland, United StatesFirst seen today
- Cyber-Physical Social System Research ScientistNational Institute of Standards and Technology · Gaithersburg, Maryland, United StatesFirst seen today
- FSP-Associate Research Scientist-CharacterizationThermofisher · Collegeville, Pennsylvania, USAFirst seen 6d ago
- Assistant Research Scientist - Dissemination and ImplementationSanford · WI, MarshfieldFirst seen 6d ago
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job