Mercor Logo

Mercor

Research Engineer Intern - Environments, Data and Post-Training

Posted Yesterday
Be an Early Applicant
In-Office
San Francisco, CA, USA
Internship
In-Office
San Francisco, CA, USA
Internship
Conduct applied AI research on post-training and RLVR for large language models. Design reward-shaping experiments, build scalable synthetic data and augmentation pipelines, develop evaluators and rubrics, and operate large-scale benchmarks and metrics. Analyze data quality and model performance while collaborating with AI researchers and training-data experts. The role requires strong coding, machine learning, algorithms, backend systems, and experimental reasoning skills in a fast-paced, in-person environment.
The summary above was generated by AI
About Mercor

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.

 

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Role

As a Research Engineer at Mercor, you’ll work at the intersection of engineering and applied AI research. You’ll contribute directly to post-training and RLVR, synthetic data generation, and large-scale evaluation workflows that meaningfully impact frontier language models.

Your work will be used to train large language models to master tool use, agentic behavior, and real-world reasoning in real-world production environments. You’ll shape rewards, run post-training experiments, and build scalable systems that improve model performance. You’ll help design and evaluate datasets, create scalable data augmentation pipelines, and build rubrics and evaluators that push the boundaries of what LLMs can learn.

What You’ll Do
  • Work on post-training and RLVR pipelines to understand how datasets, rewards, and training strategies impact model performance.

  • Design and run reward-shaping experiments and algorithmic improvements (e.g., GRPO, DAPO) to improve LLM tool-use, agentic behavior, and real-world reasoning.

  • Quantify data usability, quality, and performance uplift on key benchmarks.

  • Build and maintain data generation and augmentation pipelines that scale with training needs.

  • Create and refine rubrics, evaluators, and scoring frameworks that guide training and evaluation decisions.

  • Build and operate LLM evaluation systems, benchmarks, and metrics at scale.

  • Collaborate closely with AI researchers, applied AI teams, and experts producing training data.

  • Operate in a fast-paced, experimental research environment with rapid iteration cycles and high ownership.

What We’re Looking For
  • Strong applied research background, with a focus on post-training and/or model evaluation.

  • Strong coding proficiency and hands-on experience working with machine learning models.

  • Strong understanding of data structures, algorithms, backend systems, and core engineering fundamentals.

  • Familiarity with APIs, SQL/NoSQL databases, and cloud platforms.

  • Ability to reason deeply about model behavior, experimental results, and data quality.

  • Excitement to work in person in San Francisco, five days a week (with optional remote Saturdays), and thrive in a high-intensity, high-ownership environment.

Nice To Have
  • Real-world post-training team experience in industry (highest priority).

  • Publications at top-tier conferences (NeurIPS, ICML, ACL).

  • Experience training models or evaluating model performance.

  • Experience in synthetic data generation, LLM evaluations, or RL-style workflows.

  • Work samples, artifacts, or code repositories demonstrating relevant skills.

Benefits
  • Health Benefits eligible at 30+ hours a week

  • Overtime eligible at 1.5x from 40 to 55 hours; 2x over 55 hours-week.

  • $1.5K monthly stipend for meals

  • Relocation & Housing Support

  • Free Equinox membership

  • $200 monthly laundry reimbursement

  • $200 monthly personal wellness reimbursement

HQ

Mercor San Francisco, California, USA Office

San Francisco, California , United States, 94105

Similar Jobs

47 Minutes Ago
Hybrid
Santa Clara, CA, USA
174K-272K Annually
Senior level
174K-272K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Manage post-acquisition integration initiatives from strategy through execution, ensuring value realization, operational readiness, cost tracking, KPI performance, and issue resolution. Establish integration management offices and meeting cadences, coordinate business and functional stakeholders, support multiple acquisitions, and communicate progress to executives. Contribute to integration playbooks, tools, lessons learned, and continuous process improvement.
48 Minutes Ago
Hybrid
San Francisco, CA, USA
69K-215K Annually
Senior level
69K-215K Annually
Senior level
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Underwrites complex Builders’ Risk policies for construction, renovation, infrastructure, and related projects. Evaluates exposures, project plans, valuations, contracts, catastrophe risks, loss history, coverage terms, deductibles, exclusions, and pricing. Manages broker and client relationships, develops profitable business, monitors evolving risks, collaborates with claims, actuarial, legal, and risk engineering teams, analyzes portfolio performance, improves underwriting processes, and mentors junior underwriters.
54 Minutes Ago
Hybrid
161K-277K Annually
Senior level
161K-277K Annually
Senior level
AdTech • eCommerce • Information Technology • Software • Travel • Generative AI
Own the end-to-end design of Vrbo’s Trips experience across web and app, from opportunity framing through launch and iteration. Design accessible, brand-aligned experiences for trip planning and group coordination, using research, analytics, experimentation, and prototypes. Partner with product, engineering, content, and research teams, explore AI-enabled experiences, and elevate team craft through critiques, design reviews, mentoring, and advocacy for inclusion.
Top Skills: Design SystemsGenerative AiLarge Language ModelsPrototyping Tools

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account