SuperAnnotate Logo

SuperAnnotate

Research Engineer

Reposted 16 Days Ago
Be an Early Applicant
Hybrid
San Francisco, CA, USA
180K-250K Annually
Mid level
Hybrid
San Francisco, CA, USA
180K-250K Annually
Mid level
Perform end-to-end research engineering: find and reproduce relevant papers, implement and validate methods, build MVPs (including environments/eval harnesses and annotation workflows), partner with technical and strategic leads, and convert research into datasets, pilots, publications, or customer deliverables.
The summary above was generated by AI
About SuperAnnotate
 
SuperAnnotate builds the data that pushes AI forward. Frontier AI labs and leading enterprises rely on us to create, evaluate, and improve the data behind their models, across every modality and every stage of training. We blend technology, human intelligence, and operational excellence to deliver datasets that measurably move model performance. Backed by NVIDIA, Dell Technologies Capital, and Databricks, SuperAnnotate is a fast-growing Series B company at the center of the race to build frontier AI.

The Impact You'll Make

Our research team is expanding to keep pace with a wave of frontier-facing work: internal research streams, client engagements that require real ML depth, and emerging opportunities at the cutting edge of the field. As a Research Engineer, you'll take a research direction and run with it – finding the right papers, benchmarks, and prior work, reimplementing what's relevant, and building out the process to reproduce and improve on it internally.

You'll own initiatives end to end: partnering with strategic project and technical leads to scope the work, building MVPs to validate ideas (including through human annotation and agents), and turning that work into something concrete – a customer dataset, a pilot, an internal dataset that becomes a paper or blog post, or a joint publication with a partner. You won't be handed a fully specified task list; you'll be given a direction and the autonomy to turn it into a research plan.

This is a full-time, hybrid position based in San Francisco.

What You'll Do

  • Take a research direction and independently identify supporting resources – papers, benchmarks, blog posts – then implement or reimplement the relevant methods.
  • Build and own the process to reproduce prior work internally and identify ways to improve on it.
  • Own projects (for example, an RL/agentic environment build for a partner or a novel multimodal benchmark) end to end, including scoping, MVP implementation, and validation.
  • Partner with strategic project leads and technical leads to translate ambiguous requirements into a concrete, testable research plan.
  • Validate ideas through hands-on implementation, including annotating, evaluating, or sourcing data.
  • Turn research directions into tangible outputs – a paid customer dataset, a customer pilot, an internal dataset, or a paper/blog post for publication or conference presentation.
  • Bring an ML perspective to new opportunities — assessing technical feasibility of incoming requests and helping shape proposals where research depth is needed.

What You'll Bring

  • MS or PhD in ML, CS, or a related quantitative field – or equivalent demonstrated research experience (publications, significant open-source research work, industry research).
  • Real ML depth: you understand how models are trained and evaluated, not just how to call an API. You can read a paper, judge whether its claims hold, and reimplement the method.
  • Hands-on experience with at least one of: RL/agentic systems, AI/ML evaluation and benchmarking, or multimodal ML.
  • Strong Python and the engineering ability to build and ship your own experiments – eval harnesses, environments, infrastructure – without relying on a platform team.
  • High autonomy: you can turn an ambiguous direction into a concrete research plan and notice when something's off before being told.
  • Clear technical writing

Nice To Have

  • Publication track record (first-author preferred).
  • Experience with agent or multimodal benchmarks (OSWorld, MMMU, WebArena, SWE-bench, or similar) or building RL environments/gyms.
  • Familiarity with reward modeling, reward hacking, or verifier/judge reliability.
  • Familiarity with synthetic data generation or human-in-the-loop (HITL) workflows.
  • Experience with cloud infrastructure and containerized environments.
  • A deep RL background specifically.

Why SuperAnnotate

This is a rare opportunity to work at the intersection of frontier AI research and real production impact. You'll work on projects with frontier labs that move the needle on model performance, with your work feeding directly into the next generation of agent capabilities. You'll have the opportunity to implement projects that actually matter, publish research, and present at conferences – alongside a multidisciplinary, multinational team and collaborate with some of the most prominent labs and AI companies globally.


Only shortlisted candidates will be contacted for an interview!
 
Equal Opportunity
 
We are an equal-opportunity employer and value diversity at our company. At SuperAnnotate diversity means to us making an effort to reflect the many experiences and identities of the outside world, and treating each other with fairness and without bias. Every day we foster an environment where people of all backgrounds not only belong, but excel to succeed as a company and grow together. We offer equal opportunity regardless of sex, sexual orientation, national origin, color, race, age, marital status, disability, gender identity, veterans and more.

HQ

SuperAnnotate San Francisco, California, USA Office

San Francisco, CA, United States

Similar Jobs

2 Days Ago
In-Office
Milpitas, CA, USA
159K-321K Annually
Senior level
159K-321K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Consulting
Leads software research and development advancing quantum computing integration with high-performance computing. Responsibilities include quantum circuit compilation, execution, simulation, resource estimation, scheduling, workflow frameworks, system integration, prototyping, testing, continuous integration, technical documentation, standards contributions, and research demonstrations. The role provides technical leadership, mentors engineers, evaluates technologies, contributes to open-source projects, and communicates complex concepts to technical and non-technical audiences.
Top Skills: AgileCC++GpusHigh-Performance Computing (Hpc)LlvmMlirPythonQirQuantum ComputingRustStructural Simulation Toolkit (Sst)
2 Days Ago
Hybrid
Santa Clara, CA, USA
203K-354K Annually
Expert/Leader
203K-354K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Designs data infrastructure, pipelines, transformation tools, and automated evaluation systems for agentic AI workflows. Defines metrics, ground truth standards, quality gates, dashboards, and reproducible evaluation datasets. Partners with product, engineering, and data science teams to improve AI systems, ensure data quality and reliability, establish scalable architecture, and mentor junior engineers.
Top Skills: APIsAWSData EngineeringData WarehousingDistributed Data ProcessingETLEvent-Driven SystemsGCPJavaScriptLlmsMlNow Llm ServicePythonSQL
8 Days Ago
Easy Apply
In-Office
San Francisco, CA, USA
Easy Apply
250K-400K Annually
Entry level
250K-400K Annually
Entry level
Enterprise Web • Mobile • Professional Services • Software
Conduct research on AI evaluation, rubrics, benchmarks, human judgment, preference data, and agent performance. Design rigorous experiments, validate measurement frameworks, build evaluation pipelines, and create long-horizon real-user benchmarks. Collaborate with engineers, delivery teams, customers, academics, and external labs, while publishing methods and benchmark findings. The role combines applied statistics, messy human data, research prototyping, technical writing, and deployment of research methods in live customer programs.
Top Skills: Ai Coding ToolsElixirKotlinLlm-As-Judge EvaluationPythonReactSwift

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account