Pluralis Research Logo

Pluralis Research

Research Scientist - Post-Training

Posted 5 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in San Francisco, CA, USA
Entry level
In-Office or Remote
Hiring Remotely in San Francisco, CA, USA
Entry level
Develop end-to-end reinforcement learning post-training for large language models operating across decentralized, high-latency consumer hardware. Responsibilities include building rollout ingestion, reward computation, policy updates, weight synchronization, asynchronous and off-policy algorithms, evaluation systems, and public model releases. The role requires strong Python and PyTorch engineering, hands-on RLHF/RLVR experience, and research ability in distributed or asynchronous reinforcement learning.
The summary above was generated by AI

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning.

Agora gave us a pretrained 8B model. Post-training is how we make it useful for agentic use-cases. But every post-training stack you've seen assumes a datacenter — synchronous rollouts, fast interconnects, trusted workers. Ours gets none of that. It has to run on consumer GPUs, and Macs spread across the public internet, training a model whose weights no single participant ever holds, with rollouts arriving from a geo-distributed inference pipeline at high latencies. Your primary role is to make RL post-training work here anyway — the algorithms and the system, end-to-end.

Key Responsibilities
  • Build the post-training stack: You build the RL training loop end-to-end: rollout ingestion from the geo-distributed inference pipeline, reward computation, policy updates, and getting updated weights back out to the network. You set the direction, and you make things happen.

  • Invent the algorithms: Standard RL recipes assume on-policy rollouts from fast, trusted hardware. You adapt them to asynchronous, high-latency, partially trusted generation: staleness tolerance, off-policy corrections, and communication-efficient policy updates.

  • Ship first post-trained models: You build the evals that show the models are improving, and you take the first decentralized post-trained release from run to public artifact.

What We're Looking For
  • Hands-on RL post-training: You've run RL post-training on large language models — RLHF, RLVR, or reasoning-focused RL — and touched the systems layer yourself: rollout generation, async training loops, weight synchronization. Not just launched jobs on someone else's stack.

  • Strong engineering: Production-quality Python and PyTorch: concurrency, failure handling, profiling before optimizing.

  • Research ability: Publications in RL post-training, asynchronous or distributed RL, or nearby fields are a strong signal. So is unpublished work you can defend in detail.

  • Mission alignment: You believe Protocol Learning is the viable third path for collective, trustless, and sovereign AI.

Nice to Have
  • Experience training over slow networks, or with decentralized or federated setups.

  • Familiarity with serving-engine internals such as vLLM or SGLang — our rollout pipeline is a serving system.

  • Experience with reward modeling or building verifiable-reward datasets.

  • Experience with P2P networking and NAT traversal.

  • Experience at proprietary, open-weight and open-source AI labs

Compensation & Benefits
  • Equity-Heavy Package: We offer significant ownership for key technical contributors in addition to a high base salary.

  • Remote-First Culture: Flexible work environment with team members distributed globally.

  • Visa Sponsorship: Optional full visa sponsorship and relocation support to either Australia or the US.

  • Open Problems: Training and serving frontier models on hardware you don't control, over networks you don't own, mostly has no published answers yet. You'll write some of the first ones.

FYI's
  • We work remotely across the world, with the main teams in Australia and North America. You'll need to be comfortable working across timezones.

  • Applicants must have professional-level English proficiency (written and spoken).

  • Recruiters: we aren't looking for agency support at this time. We'll reach out if we need help.

We are backed by Union Square Ventures and other tier-1 investors, and we are a world-class, deeply technical team of ML researchers. Pluralis is unapologetically ideological. We believe AI, and the world, end up on a better path if we succeed in implementing the protocol for intelligence. If this resonates, please apply.

Similar Jobs

An Hour Ago
Remote or Hybrid
Mid level
Mid level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Provide Tier II technical support for Mastercard’s Operations Command Center. Responsibilities include network analysis, troubleshooting, infrastructure changes, project support, monitoring, documentation, metrics, reporting, ticket management, escalation handling, and team guidance. The role requires broad expertise across UNIX, mainframe, production control, debit, and network operations, with shift work, on-call duties, and occasional off-hours support.
Top Skills: Batch SchedulingFile TransferFirewallsJclMainframeMplsMvsNetwork InfrastructureNetwork MonitoringRouting And SwitchingSecurity OperationsTandemTunnelingUnix
13 Hours Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead regional security incident response for high-severity enterprise incidents, directing investigations, communications, coordination, and remediation. Build incident response tools, systems, playbooks, and programs; conduct exercises and post-incident reviews; mentor team members; collaborate across security teams; engage law enforcement and industry bodies; and produce threat intelligence. The role requires expertise across multiple security domains, cloud and network technologies, scripting, and incident response leadership.
Top Skills: FirewallsGCPGoIntrusion Detection Systems (Ids)Network ProtocolsPython
13 Hours Ago
In-Office or Remote
Mid level
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Implements, operates, and improves enterprise security controls across identity, endpoints, cloud, SaaS, networks, and data. Builds automation using scripts, APIs, infrastructure-as-code, and CI/CD security checks. Supports IAM, endpoint protection, DLP, vendor risk assessments, physical access integrations, incident troubleshooting, and security operations. Partners with engineering, IT, legal, privacy, and business teams to deploy secure baselines, remediate risks, monitor control health, and improve enterprise security capabilities.
Top Skills: AWSAzure AdBashCi/CdDlpEntra IdGCPGoGoogle WorkspaceIammacOSMdmMfaOktaPythonRest ApisSaaSSlackSsoWindows

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account