Mercor Logo

Mercor

Mercor Research Fellowship — APEX

Posted 22 Days Ago
In-Office or Remote
Hiring Remotely in San Francisco, CA, USA
40K-80K Annually
Entry level
In-Office or Remote
Hiring Remotely in San Francisco, CA, USA
40K-80K Annually
Entry level
Design, build, and validate new AI benchmarks and evaluation methodologies. Fellows create task specifications and grading rubrics, collaborate with domain experts, run frontier models, analyze failures, test for contamination and gaming, and publish findings through papers, datasets, leaderboards, or internal methodologies. The fellowship provides mentorship, compute, expert labor, and access to enterprise evaluation problems.
The summary above was generated by AI
About Mercor

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.

 

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Fellowship

Mercor’s APEX benchmark family measures whether frontier AI models can actually do economically valuable work: multi-hour agentic tasks in investment banking and corporate law, real professional accounting workflows, real-world software engineering, and graduate-level science. Every APEX benchmark is built and validated with Mercor’s network of domain experts — not written from a textbook.

Alongside APEX, Mercor's economics team works to understand how AI is changing the labor market and tries to quantify its economic impacts. To do so, we leverage Mercor’s unique access to data, including: a marketplace with millions of candidates, internal AI usage metrics, enterprise data, and more.

The Mercor Research Fellowship funds people to build the next generation of benchmarks, evaluation techniques, and economic analyses of AI. You can pitch a benchmark or eval methodology you want to build — a new domain, a harder task format, a better way to measure agentic reliability — and if selected, you get the time, compute, expert labor, and mentorship to design, implement, and release it end to end. Or, on the economics side, you can pitch a study using Mercor’s proprietary data to better understand an aspect of AI’s impact on the economy and firms.

You’ll work directly with the APEX research team, get access to real enterprise evaluation problems from Mercor’s Fortune 500 and frontier-lab partners, and see your work shape how the industry measures AI capability.

Program Details

  • Duration: 3–6 months, rolling admission

  • Commitment: minimum 30 hours/week; full-time preferred

  • Location: remote, or in-person at Mercor’s San Francisco office

  • Admission: apply with a specific benchmark or eval technique you want to build — the fellowship is funded around your pitch, not a generic research rotation

What You’ll Do

  • Propose and scope a new benchmark evaluation technique, or economic study in an area not covered well by existing work

  • Build and validate it. For benchmarks, that means designing task specifications and grading rubrics with Mercor's network of vetted experts — lawyers, accountants, engineers, scientists, consultants — then piloting tasks, calibrating scoring, and running frontier models to analyze where and why they fail. For economic studies, this can mean anything from designing and running field experiments with experts on our platform to conducting empirical analyses of enterprise data.

  • Publish your results: a paper, an open dataset, a new leaderboard on APEX, or a methodology the team adopts internally — and partner with Mercor's research and engineering teams to fold what you learn back into our public work.

Focus Areas

  • Long-horizon, multi-app agentic tasks in professional services (law, finance, consulting) — extending APEX-Agents

  • Real-world software engineering evaluation beyond issue resolution — extending APEX-SWE

  • Professional accounting and finance workflows — extending APEX-Accounting

  • AI-for-Science evals: research-level mathematics, biology, materials science, and theoretical physics

  • New economic benchmarks — negotiation, management, and other capabilities that carry economic value but resist standard task formats

  • Novel evaluation methodology: contamination resistance, rubric design, human-vs-model grading agreement, cost-adjusted scoring

  • The economics of human data platforms like Mercor – pricing, matching, elasticity of supply and demand.

  • AI Theory of the Firm: what an AI-native firm looks like from the inside, and how work is actually organized within one, with a focus on empirical work.

  • Strong pitches outside this list are welcome — we fund the best ideas, not the closest fit to a template.

What We’re Looking For

  • Genuine interest in evaluation as a research discipline — not just a stepping stone to a model-building role.

  • Background in economics, CS, ML, statistics, or an adjacent field (measurement, psychometrics, HCI, social science)

  • A specific, well-scoped idea for a benchmark, eval technique, or empirical study you want to build — the fellowship is built around your pitch.

  • Comfortable in a startup environment: fast iteration, direct access to real customer problems, less hand-holding than an academic lab.

  • Able to commit at least 30 hours/week for the duration of the fellowship — during a leave, over a summer, or a flexible stretch of a PhD.

  • Bonus: experience with agentic evaluation, RL environments, or domain expertise in law, finance, medicine, or a scientific field.

Compensation & Benefits

  • 3-month stipend of $40,000 or 6-month stipend of $80,000

  • Unlimited API credits, plus a dedicated budget for GPU compute and paid expert/human-data time

  • Weekly 1:1 mentorship with a member of the APEX research team, plus regular access to the broader research org

  • Access to Mercor's marketplace and expert-network data for empirical work, subject to review

  • Access to frontier model APIs, Mercor’s internal evaluation infrastructure, and — where appropriate — real enterprise evaluation problems from Mercor’s customers

  • Optional desk in Mercor’s San Francisco office for fellows who want to be in person

  • Introductions to Mercor’s network of researchers across frontier labs and academia

  • Standout fellows are considered for a full-time offer on the APEX research team at the end of the fellowship

HQ

Mercor San Francisco, California, USA Office

San Francisco, California , United States, 94105

Similar Jobs

Yesterday
Remote or Hybrid
83K-154K Annually
Senior level
83K-154K Annually
Senior level
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Manage complex, litigated commercial general liability and construction casualty claims valued at $500,000 or more. Responsibilities include coverage analysis, liability assessment, investigations, reserving, negotiations, litigation strategy, outside counsel and expert coordination, and settlement decisions. The role requires collaboration with legal, underwriting, reinsurance, product, and subrogation teams, along with mentoring less-experienced claims professionals and contributing to process improvements.
Yesterday
Easy Apply
Remote
United States
Easy Apply
130K-140K Annually
Senior level
130K-140K Annually
Senior level
Healthtech • Software
Own actuarial models and client-facing reporting measuring cost savings, outcomes, and performance of healthcare prior authorization programs. Analyze authorization and claims data, conduct impact evaluations, reconcile projected and realized results, investigate trends, and present executive-level insights to customers and leadership. Partner with clinical, customer success, data, and actuarial teams while maintaining reproducible, auditable methodology and documentation.
Top Skills: AirflowAthenaAws S3ExcelPythonRSASSparkSQLTableau
Yesterday
Easy Apply
Remote
United States
Easy Apply
105K-115K Annually
Senior level
105K-115K Annually
Senior level
Healthtech • Software
Develop and maintain financial and cost-savings models for prior authorization initiatives. Analyze healthcare claims, authorization trends, decision patterns, and cost drivers; quantify projected savings; and deliver executive reports and recommendations. Partner with clinical and customer success teams to address authorization challenges, conduct post-implementation assessments, and refine savings strategies. This remote-first role requires approximately 5% travel for onboarding and occasional meetings.
Top Skills: Amazon AthenaApache AirflowSparkAws S3ExcelPower BIPythonRScalaSQLTableau

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account