Physical Intelligence Logo

Physical Intelligence

Data Annotation Lead

Posted 17 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
Senior level
In-Office
San Francisco, CA, USA
Senior level
Lead and scale data annotation operations from hundreds to thousands, owning throughput, quality, cost, hiring, training, tooling, vendor mix, and budget. Build multi-layer management, human-in-the-loop/autolabeling workflows, QA/rubrics, operational metrics, capacity planning, and partner with product, engineering, and research to meet SLAs and improve unit economics.
The summary above was generated by AI

Physical Intelligence is bringing general-purpose AI into the physical world. We are a group of engineers, scientists, roboticists, and company builders developing foundation models and learning algorithms to power the robots of today and the physically-actuated devices of the future.

The role

We're looking for a Data Annotation Lead to own annotation operations and scale the team behind it. Annotation is core to how our models improve, and demand is growing fast. You will scale the annotation workforce from 100s to 1,000s while raising the quality bar — designing the org, the training pipeline, the quality system, and the metrics that let it scale efficiently.

You will own the people and the operation: throughput, quality, cost, and delivery across every annotation type.

In this role you will

  • Own annotation operations end-to-end: throughput, quality, cost, and on-time delivery across all annotation types.

  • Scale the annotation workforce from 100s to 1,000s: workforce planning, org design, and the hiring and onboarding funnel.

  • Build and lead a multi-layer management structure; hire, develop, and manage managers and team leads.

  • Scale throughput with autolabeling and model-based annotation: design human-in-the-loop workflows where models pre-label and annotators review, correct, and escalate, so output grows faster than headcount.

  • Stand up the training and certification pipeline that brings new annotators and teams to the quality bar quickly and consistently.

  • Define and continuously raise the quality bar: rubrics, calibration, audit/QA loops, and quality-adjusted productivity.

  • Establish operational metrics and reporting (presence, throughput, acceptance/rejection, rework) and drive week-over-week improvement.

  • Run capacity planning and prioritization against competing demand; allocate teams to the highest-impact work.

  • Manage performance at scale with clear standards, feedback, and a fair improvement/exit process.

  • Partner with product and engineering to define annotation tooling that unlocks throughput and quality.

  • Partner with research and project leads to translate annotation needs into clear instructions, rubrics, and SLAs.

  • Own the in-house vs. vendor mix and manage external partners where used.

  • Own the annotation operating budget and unit economics; improve cost-per-annotation while protecting quality.

What you'll bring

  • 7+ years leading scaled data or annotation operations, including teams in the 100s+.

  • 3+ years as a manager of managers.

  • Track record standing up 0→1 annotation programs.

  • Deep command of annotation best practices, operations, and strategy.

  • Experience integrating autolabeling and model-based annotation into human workflows; building human-in-the-loop pipelines that raise throughput without sacrificing quality.

  • Fluency with operational and quality metrics; data-driven management of large workforces.

  • Strong cross-functional partnership with product, engineering, and research/ML.

  • Clear written and verbal communication; able to set and hold standards across a large, distributed team.

  • Working understanding of ML and why annotation quality drives model performance.

Nice to have

  • Experience in robotics, autonomous vehicles, or frontier-AI data pipelines.

  • Experience managing distributed/global and/or vendor workforces.

  • Built annotation tooling or partnered tightly with a tooling team.

  • Experience training or fine-tuning autolabeling models, or partnering closely with the ML teams that do.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Similar Jobs

24 Days Ago
In-Office
Redwood City, CA, USA
Senior level
Senior level
Artificial Intelligence • Information Technology • Robotics • Software
Lead and build an in-house data annotation team, define processes and tooling, coordinate with ML and engineering, create documentation, manage annotators, and perform annotations when needed.
Top Skills: AIMachine Learning
An Hour Ago
Easy Apply
Hybrid
San Jose, CA, USA
Easy Apply
196K-245K Annually
Senior level
196K-245K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Lead strategy and roadmap for ZPA platform infrastructure capabilities. Partner with engineering, architecture, operations, and field teams to prioritize resiliency, scalability, and operational efficiency. Translate customer and field feedback into product requirements, influence stakeholders, and deliver phased platform improvements that improve performance, reliability, and enterprise adoption.
Top Skills: Ai/MlCloud InfrastructureDistributed SystemsNetworkingPlatform ServicesPredictive AnalyticsSecurityZero Trust ExchangeZpa
An Hour Ago
In-Office
Sunnyvale, CA, USA
65-75 Hourly
Mid level
65-75 Hourly
Mid level
Cloud • Information Technology • Machine Learning
Support Talent Acquisition by building talent communities, executing recruiting events, and scaling talent programs. Partner with recruiters and hiring managers to drive pipeline strategy, track engagement metrics, and maintain recruiting data in ATS and sourcing tools. Coordinate logistics for virtual and onsite events and improve recruiting processes as the company scales.
Top Skills: AsanaGemGreenhouseLinkedin Recruiter

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account