Mercor Logo

Mercor

Product Operations Manager, Research Services

Posted 26 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
140K-210K Annually
Mid level
In-Office
San Francisco, CA, USA
140K-210K Annually
Mid level
Own benchmark and evaluation prioritization, coordinate training and inference partners, forecast capacity, manage budgets and SLAs, track customer delivery, and lead operational reviews. Translate recurring delivery issues into product requirements and partner with Engineering to automate workflows. The role requires technical fluency in LLM evaluation, post-training methods, inference economics, SQL, and Python, plus strong project management, vendor judgment, communication, and ownership.
The summary above was generated by AI
About Mercor

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.

 

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Role

As a Product Operations Manager, Research Services, you'll drive operational excellence to support Mercor's full-service research partnerships. You will prioritize and manage delivery across various strategic customer segments to support model evaluations, diagnose model capability gaps, and fulfill post-training demand to better support our most strategic customers. This is a highly technical, internally-facing role in the Product Operations job family at the intersection of Product, Engineering, Data Production, GTM, Finance, and Strategic Partnerships.

What You'll Do
  • Prioritize the Benchmark Portfolio: Own the intake and prioritization of new benchmarks and evaluations supported in our platform. Weigh customer demand, observed capability gaps, differentiation versus public benchmarks, and build cost to inform our priorities.

  • Support Dataset Demand Generation: Run and share leaderboard evals to drive Mercor’s research brand equity during new model releases.

  • Manage Training and Inference Partners & Budgets: Own the relationships with our inference providers, compute partners, and external training vendors. Forecast capacity against the delivery calendar, negotiate and track SLAs and rate cards, monitor cost per eval run and per rollout, and qualify new partners before we need them.

  • Track Customer Delivery: Maintain the operating picture across every active evals, loss analysis, and post-training engagements, highlighting scope, milestones, dependencies, and SLA status. Run the delivery review, escalate slipping commitments before the customer notices, and give research counterparts a straight answer on where things stand.

  • Shape the Product: Translate recurring delivery friction into product requirements for the eval platform and partner with Engineering to automate the workflows you'd otherwise be running by hand.

What We're Looking For
  • Experience: 3+ years in Product Operations, Product Management, Technical Program Management, Research Operations, Solutions Engineering, or a similar technical, customer-facing role. Experience operating in an ML research or AI infrastructure environment strongly preferred.

  • Technical Fluency: Fluent in how modern LLM evaluation works, including harness design, verification, agentic rollouts, and contamination and fairness pitfalls. Working understanding of post-training (SFT, preference ranking, RL) and of inference economics. Familiar with coding agents; comfortable in SQL and Python without agent assistance.

  • Vendor and Capacity Judgment: Can plan capacity against an uncertain demand curve, hold partners to an SLA, and weigh cost against reliability without needing to escalate every call.

  • Ownership: Thrive in ambiguous environments and take ownership from problem definition through execution. Comfortable being the person accountable for a date.

  • Communication: Can hold your own in a technical conversation with AI researchers and write a status update an executive can act on. Excellent written and verbal communication.

  • Systems Thinking: Strong project management and cross-functional coordination skills. Passion for fixing problems at the source and building repeatable systems rather than one-off solutions.

Benefits

  • Bi-annual performance bonus structure

  • Generous equity grant vested over 4 years

  • Up to $15k Relocation bonus

  • $10K housing bonus (if you live within 0.5 miles of our office)

  • $1.5K monthly stipend for meals

  • Free Equinox membership

  • $200 monthly laundry reimbursement

  • $200 monthly personal wellness reimbursement

  • Health, Dental, Vision insurance

HQ

Mercor San Francisco, California, USA Office

San Francisco, California , United States, 94105

Similar Jobs

Yesterday
In-Office
16-29 Hourly
Junior
16-29 Hourly
Junior
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Manages member and provider referral intake, admission and discharge information, service requests, and incoming and outgoing cases. Coordinates with hospitals, clinics, facilities, and clinical teams while performing non-clinical triage, outreach, submissions, notifications, and issue resolution. The role operates in a high-volume customer service environment and requires knowledge of medical coding, insurance-related care coordination, and referral processing.
Top Skills: Cpt CodesIcd-10Icd-9MS Office
Yesterday
In-Office
16-29 Hourly
Junior
16-29 Hourly
Junior
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Provide front-desk patient support including check-in/check-out, demographic and insurance verification, scheduling, cash handling, medical records management, answering phones, and processing authorizations and releases.
Top Skills: EmrExcelMicrosoft OutlookMicrosoft PowerpointMicrosoft Word
Yesterday
In-Office
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads complex claims extract implementations, client onboarding, vendor integrations, data interfaces, and enterprise programs. Coordinates cross-functional teams, dependencies, releases, risks, budgets, and governance while overseeing QA, testing, ServiceNow requests, metrics, and SLA compliance. Drives process improvement, automation, customer experience, and NPS outcomes. Acts as a subject matter expert and mentor for project managers and analysts, supporting Agile teams and staffing decisions.
Top Skills: AgileJIRASafeScrumServicenow

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account