AfterQuery Logo

AfterQuery

Machine Learning Engineer - Quality Intelligence

Reposted 13 Days Ago
In-Office
San Francisco, CA, USA
Mid level
In-Office
San Francisco, CA, USA
Mid level
Build production ML and data systems to measure and improve data quality. Develop expert-matching, quality prediction, anomaly detection, and evaluation infrastructure. Convert messy signals into models, metrics, and product improvements while partnering with engineers and domain experts and owning systems from design to deployment.
The summary above was generated by AI
About AfterQuery

AfterQuery is an applied research lab curating data solutions for foundation model development.

We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it. Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve.

This is a rare opportunity to join a company at a defining moment in AI. Since raising our $30M Series A at a $300M valuation, AfterQuery has grown well over a $100M revenue run rate.

We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.

Why Apply
  • Massive Opportunity:
    We are one of the fastest-growing YC companies in our batch, and we believe we can become one of the fastest-growing YC companies of all time.

  • Founding Impact:
    You will own and architect core infrastructure systems that power our platform from the ground up.

  • Equity & Growth:
    Competitive salary and meaningful equity. As we scale, you’ll have the opportunity to shape the engineering organization and lead major technical initiatives.

  • Strong Team:
    Our founding team has experience from Citadel Securities, Meta, Google, Silver Lake, and Morgan Stanley — work alongside world-class engineers and researchers.

Overview

AfterQuery builds the data and evaluation systems that power frontier AI models. Every leading AI lab uses our datasets and reinforcement learning environments to encode and scale real-world expertise.

We’re hiring a Founding Machine Learning Engineer, Quality Intelligence to build the ML systems behind how we measure, improve, and scale data quality. You’ll work on production systems at the intersection of machine learning, human expertise, and frontier model evaluation.

This role is for someone who wants to build practical ML systems that directly improve the quality, reliability, and scalability of expert human data.

Responsibilities

Build ML and data systems that help measure quality across complex human data workflows

Develop systems for expert matching, quality prediction, and anomaly detection

Build evaluation infrastructure for tasks, reviewers, projects, and data deliveries

Turn messy real-world signals into models, metrics, and product improvements

Partner with engineers, domain experts, and operators to improve how high-quality data is created and reviewed

Own high-impact systems from early design through production deployment

Required Qualifications

3-6 YOE with relevant experiences

Strong software engineering background with experience shipping production systems

Experience with applied ML, ranking, recommendations, search quality, marketplace systems, trust/safety, fraud, or data quality systems

Strong data intuition and ability to work with messy, ambiguous real-world signals

Comfort working across backend systems, data pipelines, ML models, and internal tools

Ability to move quickly in a high-ownership, fast-changing environment

Deep care for quality, precision, and customer impact

Not a Fit If
  • You want to do pure research without owning production systems

  • You only want to train models and not build product infrastructure

  • You need clean datasets and perfectly scoped problems

  • You do not want to work closely with users, operators, and domain experts

Similar Jobs

13 Days Ago
Hybrid
Mountain View, CA, USA
140K-217K Annually
Mid level
140K-217K Annually
Mid level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build and productionize agentic AI systems: improve agent behavior, reliability, latency, and quality using LLMs, multimodal models, and vector databases. Design eval benchmarks, manage training and evaluation datasets, implement context engineering, orchestration, multilingual and multimodal support, and partner with platform teams to deliver production-grade, tested ML-driven features.
Top Skills: GoHybrid Vector DatabasesLlmsMultimodal Foundation ModelsPythonVector Databases
13 Days Ago
Hybrid
Mountain View, CA, USA
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design and productionize agentic AI systems and components, improve agent behavior and reliability, create eval benchmarks and high-quality datasets, tune and evaluate LLMs and models, optimize latency and reliability in production, and partner with platform and UI teams to deliver end-to-end ML solutions.
Top Skills: Deep Learning ArchitecturesGoHybrid Vector DatabasesLlmsMultimodal Foundation ModelsPython
13 Days Ago
Hybrid
Mountain View, CA, USA
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design, evaluate, and productionize agentic AI systems and LLM-driven components to improve agent behavior, reliability, latency, and user-facing experiences. Build eval benchmarks, tune models, manage data quality, and collaborate with platform teams to deploy scalable, safe, and high-performing AI features.
Top Skills: Deep LearningGoLarge Language ModelsmacOSMultimodal Foundation ModelsPythonVector Databases

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account