Cognition Logo

Cognition

Research Engineer, Mid-Training

Posted 5 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
Entry level
In-Office
San Francisco, CA, USA
Entry level
Own late-stage LLM training decisions across data mixing, capability injection, synthetic data, annealing schedules, context extension, evaluation, and scaling. Develop methods that improve coding, mathematics, and long-horizon reasoning while translating research into production training systems. The role requires end-to-end understanding of the LLM pipeline, hands-on large-model training experience, strong optimization and machine learning fundamentals, and demonstrated original technical contributions.
The summary above was generated by AI
We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer.

Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

Role Mission

Mid-training sits at the seam between pre-training and post-training and is one of the highest-leverage points in the entire model pipeline. This is where raw base model capability is sharpened into something that can reason deeply, generalize reliably, and serve as the foundation that post-training builds on.

You will own the late-stage training decisions that determine what our models are fundamentally capable of: data mix and quality uplift, annealing schedules, context length extension, capability injection across coding, math, and reasoning, and the synthetic data strategies that make all of it scale. This role does cross-cutting work across what is classically considered both pre-training and post-training. We don't distinguish between research and engineering; we expect both.

What You'll Accomplish
  • Data Mix and Quality Uplift: Design and iterate on high-quality data mixtures for late-stage and annealing training runs. Develop principled methods for sourcing, filtering, and weighting data to sharpen model capabilities without degrading general performance.

  • Capability Injection: Drive targeted improvements in coding, mathematics, and long-horizon reasoning through curated data strategies and training interventions. Translate research insights into measurable capability gains on our agents.

  • Synthetic Data Research: Develop and evaluate synthetic data pipelines that generate training signal at scale. Understand the limits and failure modes of synthetic approaches and build methods that hold up in production training runs.

  • Annealing and Schedule Design: Research and optimize multi-stage learning rate schedules, warmup strategies, and compute allocation across training phases. Understand how schedule choices interact with data distribution and model behavior.

  • Context Length Extension: Research and implement methods for extending effective context length without degrading short-context performance. This includes positional encoding strategies, data construction, and targeted evaluation.

  • Evaluation and Iteration: Build evals that distinguish real capability improvements from benchmark overfitting. Close the loop between training decisions and what actually matters for Devin and our other systems in deployment.

  • Scaling and Methodology: Measure how mid-training interventions scale with compute and data. Develop new approaches when existing methods hit ceilings; we expect both rigorous empiricism and original thinking.

Exceptional Candidates Have Demonstrated
  • Deep familiarity with the LLM training pipeline end to end: pre-training data, optimization, architecture, and how mid-training and post-training interact

  • Hands-on experience with continual pre-training, annealing, or late-stage data mixing for large models

  • Strong intuition for data quality: what makes a dataset useful for training, how to filter and curate at scale, and how data mix choices compound across evals

  • Experience developing or evaluating synthetic data pipelines for capability improvement

  • Proficiency in Python and deep learning frameworks (PyTorch); comfortable debugging distributed training at scale

  • Strong fundamentals in optimization, statistics, and ML theory; able to distinguish real effects from noise, instability, and overfitting

  • A track record of original contributions: publications, open-source impact, or internal results that moved a capability frontier

  • Comfort operating in ambiguous, fast-moving environments where the problem definition is as important as the solution

  • We care more about demonstrated capability than credentials. A PhD is one signal among many.

Resources & Environment
  • Small, highly selective team where research and product move together; prototypes reach real deployment quickly

  • Compute is not a constraint: large allocations with training jobs routinely running across thousands of GPUs from day one

  • The environment rewards speed, autonomy, and technical depth with minimal process overhead; this is one of the most competitive and fast-moving problems in AI

Our Commitment

Equal Opportunity. Cognition is an equal opportunity employer. We do not discriminate on the basis of any protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any. Cognition also considers applicants with criminal histories consistent with the SF Fair Chance Ordinance and similar local laws.

Data Privacy and Arbitration: By submitting your application, you agree to our Global Applicant and Job Candidate Privacy Notice. For US applicants, by submitting your application, you agree to the Applicant Arbitration Agreement.

HQ

Cognition San Francisco, California, USA Office

San Francisco, CA, United States

Similar Jobs

10 Minutes Ago
In-Office or Remote
United States
76K-126K Annually
Junior
76K-126K Annually
Junior
Big Data • Information Technology • Software • Analytics • Energy
Configure, test, and implement Automated Utility Design software for electric utility clients. Translate client standards into software configurations, lead requirements workshops, support testing and training, troubleshoot technical issues, document solutions, and track project delivery. The role combines utility design or drafting experience with software configuration, client-facing consulting, and basic programming knowledge.
Top Skills: .NetAutocad Map 3DAutodesk AutocadC#Esri ArcgisGe SmallworldGisPythonSbs Automated Utility Design (Aud)SQL
16 Minutes Ago
Hybrid
Union City, CA, USA
23-31 Hourly
Junior
23-31 Hourly
Junior
Fintech • Financial Services
Provides banking support across multiple branches, builds customer relationships, opens accounts, processes service requests and credit applications, handles cash transactions, promotes banking products, and makes referrals. Requires bilingual Spanish and English proficiency, strong compliance awareness, digital tool adoption, flexibility across branch environments, and 100% travel within the assigned geography.
Top Skills: Digital Banking ToolsSafe Registration
16 Minutes Ago
Hybrid
23-31 Hourly
Entry level
23-31 Hourly
Entry level
Fintech • Financial Services
Build customer relationships in a bank branch by understanding financial needs, recommending appropriate products and services, opening accounts, processing transactions, supporting credit applications, and making referrals. The role combines customer service, sales growth, cash handling, regulatory compliance, digital banking support, and collaboration with branch specialists. Spanish and English bilingual proficiency is required, along with Saturday availability and SAFE registration after employment.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account