Pramana Labs Logo

Pramana Labs

Research Scientist, Reinforcement Learning

Posted 12 Days Ago
Be an Early Applicant
In-Office
Palo Alto, CA, USA
Entry level
In-Office
Palo Alto, CA, USA
Entry level
Conduct research on reinforcement learning post-training for reasoning models. Develop RLVR methods using Lean 4’s verified rewards, create novel RL algorithms and test-time compute optimizations, advance autoformalization, curate training data, and build evaluations for formal reasoning. The role owns the full research loop from rollout sampling and reward design through model updates and evaluation, with emphasis on autonomous, state-of-the-art research in long-horizon logical tasks.
The summary above was generated by AI
Company

Pramaana Labs is a frontier AI lab building the verification layer for AI. Founded in 2025 and headquartered in Palo Alto, we turn complex human knowledge, including tax codes, legal rules, clinical guidelines and security protocols, into a formal representation, so every AI answer can be traced, challenged, and proved.

Pramaana's architecture pairs foundation models trained to formalize and reason with a symbolic world model encoded in Lean 4. Pramaana was founded by a team out of Google, DeepMind, and Glean, combining frontier AI researchers and formal methods experts.

The role

We're training foundation models to natively interact with symbolic world models. As an RL Post-Training Researcher, you'll take foundation models and scale their reasoning capabilities: applying RLVR to new domains using verified rewards from the Lean kernel, pushing the frontier of autoformalization and proving, and innovating on RL algorithms, data, and evals. Your work will also define how our models leverage test-time compute to solve long-horizon logical tasks.

What you'll actually work on
  • Scale RLVR to new, real-world domains using the Lean kernel as a deterministic reward signal.

  • Design and implement novel RL algorithms and test-time compute optimizations tailored for formal environments and proof search.

  • Push the frontier of autoformalization, training models to map highly technical natural language into strict formal specifications.

  • Curate data and build evals that tightly correlate with verifiable downstream reasoning capabilities.

  • Own the whole loop: rollout sampling, reward design, the update, the eval.

You Will Thrive in This Role If You Have
  • Deep, hands-on research experience in reinforcement learning applied to reasoning models at scale.

  • Experience working with RLVR, test-time RL, or exact deterministic reward signals.

  • Strong algorithmic and systems intuition — comfortable writing custom RL loops, managing data pipelines, and building robust evals from scratch.

  • High autonomy: the ability to take a fuzzy problem area and independently drive it to state-of-the-art results without day-to-day direction.

Especially Strong Candidates May Also Have
  • A background in formal verification (Lean, Coq, or Isabelle)

  • A strong publication record in top-tier venues (NeurIPS, ICML, ICLR).

Similar Jobs

8 Days Ago
Hybrid
San Francisco, CA, USA
230K-450K Annually
Entry level
230K-450K Annually
Entry level
Artificial Intelligence • Legal Tech • Professional Services • Software
Own research and engineering efforts to improve open-weight language models for legal reasoning and agentic workflows. Design and run SFT and reinforcement learning experiments, develop reward functions and verifiers, build rigorous evaluations, debug large-scale distributed training, and translate research results into customer-facing model improvements.
Top Skills: Distributed TrainingLarge Language Models (Llms)Open-Weight ModelsPreference OptimizationPythonReinforcement LearningReward ModelingSupervised Fine-Tuning (Sft)
22 Days Ago
In-Office or Remote
San Francisco, CA, USA
150K-350K Annually
Entry level
150K-350K Annually
Entry level
Artificial Intelligence • Software
Research Engineer or Scientist developing reinforcement learning algorithms and systems for frontier AI models. Responsibilities include researching policy optimization, asynchronous RL stability, scaling behavior, controlled experiments, evaluations, training recipes, and distributed RL frameworks. The role also involves extending prime-rl, improving numerical correctness and performance, and diagnosing unstable training runs and regressions.
Top Skills: Asynchronous Rollout PipelinesDistributed Training FrameworksPrime-RlPythonPyTorch
2 Months Ago
In-Office
San Francisco, CA, USA
Senior level
Senior level
Healthtech • Software
Lead post-pretraining work on multimodal medical vision-language models: fine-tuning, reward modeling, RL (including RLHF), chain-of-thought and tool-use training, inference-time strategies, and publishable research to enable clinically grounded radiology report generation.
Top Skills: Autoregressive Language ModelingCispoDapoDistributed TrainingDpoGrpoGspoInstruction TuningInternvlIpoJaxKtoLlavaMulti-GpuOpenrlhfOrpoPyTorchQwen-VlSglangTrlVerlVllm

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account