AfterQuery Logo

AfterQuery

Research Scientist - Post Training

Reposted One Month Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
210K-450K Annually
Junior
In-Office
San Francisco, CA, USA
210K-450K Annually
Junior
Design and run controlled SFT and RL post-training experiments to measure dataset impact on model capability, generalization, and alignment. Build public evaluations, publish research and reports, and iterate on data quality with internal teams and partner labs.
The summary above was generated by AI
About AfterQuery

AfterQuery is an applied research lab curating data solutions for foundation model development. We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it.

Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve. This is a rare opportunity to join a company at a defining moment in AI. Forbes reported that we could be YC's fastest unicorn, reportedly raising at a $3.2 billion valuation. We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.

Why Apply

Massive Opportunity: Forbes reported that we could be YC's fastest unicorn, reportedly raising at a $3.2 billion valuation, and we're not slowing down.

Founding Impact: You will own and architect core infrastructure systems that power our platform from the ground up.

Equity & Growth: Competitive salary and meaningful equity. As we scale, you’ll have the opportunity to shape the engineering organization and lead major technical initiatives.

Strong Team: Our founding team has experience from Citadel Securities, Meta, Google, Silver Lake, and Morgan Stanley — work alongside world-class engineers and researchers.

Overview

Your job is to prove that our data works. You will design and run training experiments that isolate the impact of our datasets on model behavior. This includes SFT and RL-based post-training, where you’ll measure how different data sources shift capability, generalization, and alignment. Working closely with partner labs, you will turn our datasets into clear, defensible evidence: this data → this improvement → under these conditions. This is experimental, high-leverage work.

Responsibilities
  • Run controlled SFT and RL experiments to measure the impact of our datasets on model performance.

  • Help build public evals and new data types that push the frontier.

  • Publish external-facing research, blog posts, and technical reports.

  • Work with internal SPLs to iterate on data quality based on your results.

Required Qualifications
  • Strong familiarity with LLM training and evaluation methodologies.

  • Ability to design lightweight experiments, move fast, and extract actionable insights from messy results.

  • Comfort working across domains (you'll touch finance, software engineering, policy, and more).

  • A bias toward building over theorizing.

Preferred Qualifications
  • Great candidates are undergrad research or master's research (but haven't done a phd).

  • Genuine obsession with how data structure, selection, and quality drive model behavior.

Company Benefits (For Eligible Employees):
  • Health Insurance: Medical, Vision, Dental

  • 401(k) with Employer Match

  • Daily Meals: Daily UberEats Stipend

  • Monthly Wellness Stipend

We are an equal opportunity employer committed to providing a workplace free from discrimination and harassment. Employment decisions are made without regard to legally protected characteristics under applicable federal, state, or local law.

We comply with applicable pay transparency requirements and provide compensation ranges based on the position, qualifications, experience, and other relevant factors. Reasonable accommodations are available to qualified individuals with disabilities and for sincerely held religious beliefs, as required by law. This job description is intended to describe the general nature and level of work performed and is not an exhaustive list of all duties, responsibilities, qualifications, or working conditions associated with the position. We reserve the right to modify this job description as business needs change.

Similar Jobs

19 Days Ago
In-Office
San Francisco, CA, USA
250K-500K Annually
Entry level
250K-500K Annually
Entry level
Artificial Intelligence • Software
Develop and implement frontier-model post-training methods, including reinforcement learning, verifiable rewards, evaluation, and data-centric optimization. Design rigorous experiments across datasets, rewards, environments, and training strategies; investigate model behavior and failure modes; build scalable data-generation and evaluation pipelines; and create benchmarks, rubrics, and scoring systems. Collaborate with researchers, engineers, AI teams, customers, and domain experts while contributing to open-source tools, technical reports, blog posts, and research papers.
Top Skills: APIsCloud InfrastructureDapoDatabasesDistributed SystemsGrpoMachine LearningReinforcement LearningRlvr
One Month Ago
In-Office
San Francisco, CA, USA
166K-207K Annually
Entry level
166K-207K Annually
Entry level
Artificial Intelligence • Big Data • Machine Learning
Research and develop novel post-training methods such as SFT, RLHF, reward modeling, and preference optimization for text and multimodal LLMs. Analyze model behavior, improve alignment and generalization, mitigate bias, enhance robustness, and publish findings at leading AI conferences. Collaborate with engineers, researchers, and foundation model labs to establish data-driven AI development practices and provide technical and strategic guidance.
Top Skills: Deep LearningInstruction TuningLlmsMultimodal AiPreference OptimizationReinforcement LearningReinforcement Learning From Human Feedback (Rlhf)Reward ModelingSupervised Fine-Tuning (Sft)
One Month Ago
In-Office
San Francisco, CA, USA
Senior level
Senior level
Healthtech • Software
Lead post-pretraining work on multimodal medical vision-language models: fine-tuning, reward modeling, RL (including RLHF), chain-of-thought and tool-use training, inference-time strategies, and publishable research to enable clinically grounded radiology report generation.
Top Skills: Autoregressive Language ModelingCispoDapoDistributed TrainingDpoGrpoGspoInstruction TuningInternvlIpoJaxKtoLlavaMulti-GpuOpenrlhfOrpoPyTorchQwen-VlSglangTrlVerlVllm

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account