Build reinforcement learning systems from the ground up, including environments, reward functions, training pipelines, evaluation frameworks, and production systems. Train and fine-tune models using RL methods, scale training across GPU clusters, conduct experiments, and guide technical direction. The role also contributes to engineering culture and future hiring while working closely with company founders in an on-site early-stage environment.
Founding RL Engineer
San Francisco, CA, on-site · Full-time
The build: Our client is hiring a Founding Reinforcement
Learning Engineer to build the core RL systems from the ground up. You'll work
directly with the founders, own the full loop from environment design to
training to evaluation, and help shape the technical direction of the company.
What you'll do
- Design
and build RL environments, reward functions, and training pipelines.
- Train
and fine-tune models with RL methods (PPO, GRPO, DPO, RLHF/RLAIF and
similar).
- Build
evaluation frameworks to measure model and agent performance.
- Run
experiments fast, read results, and decide what to try next.
- Scale
training on GPU clusters and keep pipelines reliable.
- Turn
research ideas into production systems.
- Help
set engineering culture and hire the next engineers.
Requirements
What we're looking for
- 2+
years of hands-on experience in reinforcement learning or ML engineering.
- Strong
Python skills and deep experience with PyTorch (or JAX).
- Hands-on
work training models with RL (policy gradient methods, reward modeling,
RLHF or similar).
- Experience
with LLM post-training or agent training is a big plus.
- Comfortable
with distributed training and GPU infrastructure.
- Builder
mindset: you ship fast and are happy in a small, early team.
- Degree
in CS, Math, Physics, or a related field (MS/PhD a plus).
Nice to have
- Publications
or open-source work in RL.
- Experience
at an AI lab or an early-stage AI startup.
- Experience
with simulation or environment frameworks (Gymnasium, Ray RLlib, Isaac,
MuJoCo).
- Experience
with training libraries like TRL, verl, or OpenRLHF.
Logistics: San Francisco, CA, on-site.
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and ship high-quality frontend software from technical design through launch. Develop efficient, scalable, testable client code; collaborate with engineering, design, and product teams to solve customer problems; contribute to code reviews and documentation; and resolve complex bugs while delivering intuitive product experiences.
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Partners with sales teams to support mid-market customers throughout the pre-sales cycle. Conducts discovery, identifies business problems, maps needs to Atlassian products, leads customized value-based demonstrations, guides technical decisions, expands cross-product opportunities, and builds executive relationships. Tracks customer feedback and competitive intelligence, collaborates with product management, and continuously develops product, solution, platform, and sales expertise.
Top Skills:
Artificial IntelligenceAtlassian ProductsAtlassian SoftwareCloud Computing
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Develop and maintain large-scale full-stack product features, guiding technical direction and balancing correctness, performance, reliability, security, and customer impact. Collaborate with product, design, and engineering teams to build dynamic user experiences, write tested and maintainable code, conduct code reviews, document systems, debug complex issues, and resolve production problems.
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
