Handshake Logo

Handshake

Senior Product Manager, RL Environments — Handshake AI

Reposted Yesterday
Be an Early Applicant
In-Office
San Francisco, CA, USA
180K-220K Annually
Senior level
In-Office
San Francisco, CA, USA
180K-220K Annually
Senior level
The Senior Product Manager will lead the development of platforms for creating RL environments efficiently, collaborating across teams to improve workflows and quality. Responsibilities include defining product roadmaps, enhancing operator tooling, and measuring success metrics.
The summary above was generated by AI
About Handshake

Handshake is the career network for the AI economy. 20 million knowledge workers, 1,600 educational institutions, 1 million employers (including 100% of the Fortune 50), and every foundational AI lab trust Handshake to power career discovery, hiring, and upskilling, from freelance AI training gigs to first internships to full-time careers and beyond. This unique value is leading to unparalleled growth; in 2025, we tripled our ARR at scale.

Why join Handshake now:

  • Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel

  • Work hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions

  • Join a team with leadership from Scale AI, Meta, xAI, Notion, Coinbase, and Palantir, among others

  • Build a massive, fast-growing business with billions in revenue

About the Role

Handshake AI builds the training data that frontier labs use to push their models forward. A growing share of that work is in reinforcement learning: realistic, end-to-end environments where models can be evaluated and trained against real-world workflows. We’re hiring a Senior Product Manager to own the product surface that turns environment creation from a bespoke, weeks-long lift into a repeatable factory.

Today, building a single RL environment is a substantial cross-team effort involving dozens of manual steps across operators and engineers, and depends on tribal knowledge across data sourcing, de-identification, synthetic data generation, tool building, packaging, and quality assurance. Frontier labs are asking for environments across many verticals at once, and the manual model doesn’t scale. Your job is to make it scale: design and ship the platform that compresses lead time, replaces hand-built workflows with self-serve tooling, and lets a small team of operators turn out high-quality environments for any vertical our customers prioritize.

You’ll sit at the bridge between Operations and Engineering. Operators are running data pipelines locally, manually de-identifying datasets, manually QA’ing tools, and chasing customer deliveries. You’ll translate that work into a product roadmap, partner with our engineering leads on architecture and execution, and keep our research, GTM, and customer-facing teams aligned on what good looks like.

This is a high-leverage, 0→1 role inside a fast-moving research-adjacent product space. You’ll work cross-functionally with Forward Deployed Engineering, Operations, Research, Design, and GTM, and your work will directly determine how many environments Handshake can ship, how fast, and at what quality bar.

What you’ll own
  • The Environment Factory. The end-to-end product experience for building and shipping an RL environment. Today this is a manual playbook; you’ll define and ship the platform that lets operators run many environments in parallel, with most steps in-product rather than off-platform.

  • Tooling, packaging, and delivery. Drive the roadmap for the tool registry, environment packaging, and customer delivery so labs receive a portable, deployable environment that runs reliably in their own infrastructure. Reduce time-to-deliver and the rate of last-minute rework on the day of delivery.

  • Quality at the frontier-lab bar. Own the leveling framework for environment quality (currently L1–L5 by vertical and persona) and the roadmap that gets priority verticals from L1 to L4+. Define and ship the QA tooling that turns environment, task, and rollout QA from a manual review into a productized check.

  • Operator tooling. Operators are your primary users. Build the dashboards, in-product workflows, and self-serve flows that replace the manual work they do today from data transformation to environment QA to delivery cutoffs.

  • Goals and metrics. Define and track targets including: environment lead time, environments delivered per quarter, % of in-platform vs. off-platform steps in environment creation, environment quality level by vertical, QA pass rate on environments/tasks/rollouts, tool registry coverage, and operator time per environment.

  • Cross-functional partnership. Work with Engineering on architecture and execution, with Operations on workflow and pain points, with Research on what environments need to support post-training and verifier work, with Design on operator UX, and with GTM and customer teams on what verticals to prioritize and how to package what we build.

Desired Capabilities
  • 5+ years as a product manager shipping production code with engineering teams, ideally on platform, infrastructure, or developer-tools products.

  • A track record building tools for internal users (operations, forward deployed engineers, data teams, or similar) where reducing manual work and supporting power users is the core of the job.

  • Comfortable owning a product surface with many moving parts and dependencies (data pipelines, environment runtimes, tooling, QA, packaging) and sequencing roadmap work to unblock the biggest bottleneck next.

  • Strong product instincts in ambiguous, fast-iterating spaces. You can scope a problem from a Slack thread to a PRD to a shipped feature in hours, not days, and you don’t wait for a rigid spec before moving.

  • Data-informed and action-oriented. You use lead time, throughput, quality scores, and operator pain to prioritize, and you move quickly once the signal is clear.

  • Comfortable acting as the connective tissue between Operations and Engineering, translating ops pain into engineering work, and engineering tradeoffs back into ops-readable plans.

Bonus Points
  • Background in reinforcement learning, frontier model training data, evaluations, or model post-training workflows.

  • Experience as a PM on developer tools or developer platforms, where the bar for power-user UX is high.

  • Familiarity with data pipelines, de-identification, synthetic data generation, or large-scale data QA.

  • 0→1 experience standing up new product surfaces inside a fast-moving research-adjacent org without a fully formed playbook.

  • Experience at a marketplace, gig platform, or human-data company; or exposure to AI/ML data pipelines or annotation workflows.

We Offer

Handshake delivers benefits that help you feel supported and thrive at work and in life.

The below benefits are for full-time US employees.

🎯 Ownership: Equity in a fast-growing company

💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching

🍼 Family Support: Paid parental leave, fertility benefits, parental coaching

💝 Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend

📚 Growth: $2,000 learning stipend, ongoing development

💻 Remote & Office: Internet, commuting, and free lunch/gym in our SF office

🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days

🤝 Connection: Team outings & referral bonuses

Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers.

HQ

Handshake San Francisco, California, USA Office

We're located right in the center of everything in the financial district of downtown San Francisco. We're just 1 block from Montgomery St Bart!

Similar Jobs

29 Minutes Ago
Remote or Hybrid
199K-348K Annually
Expert/Leader
199K-348K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead large-scale, cross-functional technical programs for APEX Strategic Programs, translating business objectives into execution strategy, driving governance, using AI to accelerate delivery, and coordinating stakeholders through program lifecycle to achieve measurable strategic outcomes.
Top Skills: AIAi AgentsEnterprise SaasServicenowWorkflow Automation
29 Minutes Ago
Remote or Hybrid
Santa Clara, CA, USA
255K-445K Annually
Expert/Leader
255K-445K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead technical direction for a cloud-native platform across multiple teams. Solve ambiguous platform problems (multi-cloud control plane, workload isolation, identity/trust, reliability), design and build control planes/operators, set architecture and standards, guide hyperscaler strategy, mitigate technical risks, and mentor senior engineering leaders.
Top Skills: Ai-Powered ToolingAksAWSAzureCniCrossplaneEksGCPGitopsGkeGoInfrastructure-As-CodeKata ContainersKubernetesMetricsMtlsOciOperator/Controller PatternService MeshSlosSpiffeSpireTracing
29 Minutes Ago
Remote or Hybrid
162K-223K Annually
Expert/Leader
162K-223K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead conceptual creative strategy and execution for integrated, digital-first brand and demand campaigns. Partner cross-functionally and with agencies, mentor junior creatives, optimize digital creative using performance data, and ensure scalable, on-brand creative across channels.
Top Skills: Adobe Creative Cloud

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account