Firecrawl Logo

Firecrawl

Research Engineer

Reposted One Month Ago
In-Office
San Francisco, CA, USA
250K-290K Annually
Mid level
In-Office
San Francisco, CA, USA
250K-290K Annually
Mid level
The Research Engineer will design and build evaluation systems to measure data quality for Firecrawl's web data extraction, creating metrics and benchmarks, and collaborating on model improvements.
The summary above was generated by AI
Research Engineer

You'll build the evaluation systems that tell us whether Firecrawl actually works. That sounds simple. It isn't. Our core promise, convert any URL into clean, structured, LLM-ready data reliably, is hard to measure rigorously across millions of different websites, formats, and edge cases. As the systems we're measuring get more complex, the question "did that work?" gets harder, not easier.

This isn't an eval role where you inherit a framework and run benchmarks. You'll design the metrics, build the pipelines, generate the datasets, and own the feedback loop from output quality back to model and product decisions. If you care about what "good" actually means and have the engineering depth to measure it, this is the role.

Salary Range: $250,000–$290,000/year

Equity Range: Competitive equity — details shared during the process.

Location: San Francisco, CA (Onsite)

Job Type: Full-Time

Experience: 4+ years in ML, research engineering, or data-heavy backend, with real evaluation work

Visa: Must be legally authorized to work in the United States. We're not able to sponsor visas right now, though that may change down the line.

About Firecrawl

Firecrawl is the easiest way to turn the web into data AI agents can use. One API call converts any URL into clean, LLM-ready markdown or structured data - the boring-hard problem everyone building with LLMs eventually hits, solved.

We hit 8 figures in ARR in year one and more than doubled it in year two. We have 175k+ GitHub stars, and developers, agents, and category-defining AI companies build on us every day. Growth like this is rare, and we're just getting started.

We're a small team punching far above our weight. Everyone here owns a real piece of the product and company, end to end, and runs it themselves - no hiding behind process or headcount.

This is a place for people who want to work at the frontier: an AI company building the infrastructure other AI companies run on, not one bolting AI onto an existing product. We move fast, go deep, and are building the tools superintelligence will rely on to gather data from the web.

What You'll Do
  • Design the metrics that define what "good output" actually means across millions of sites, formats, and edge cases

  • Build the pipelines and harnesses that measure quality rigorously and at scale

  • Generate and curate the datasets that make evaluation trustworthy

  • Own the feedback loop from output quality back to model and product decisions

  • Turn "did that work?" into an answer the whole team can act on

What We're Looking For
  • You have the engineering depth to build real evaluation systems, not just run existing ones

  • You care deeply about what "good" means and how to measure it rigorously

  • You're comfortable owning ambiguous problems where the metric itself has to be invented

  • You move fast and close the loop - you'd rather ship, measure, and iterate than perfect on paper

What We're NOT Looking For
  • Someone who only wants to run benchmarks someone else designed

  • A pure researcher who won't build the systems, or a pure engineer who won't think about methodology

  • Someone who needs a fully-specced ticket to start

A Note On Pace

We operate at an absurd level of urgency because the window for what we're building won't stay open forever. If that excites you, keep reading. If it doesn't, no hard feelings — but this role probably isn't for you.

Benefits & Perks

Available to all employees
  • Salary that makes sense — $250,000-$290,000/year (U.S.-based), based on impact, not tenure

  • Own a piece — Gain competitive equity in what you're helping build

  • Generous PTO — 15 days mandatory, anything after 24 days, just ask (holidays excluded); take the time you need to recharge

  • Parental leave — 12 weeks fully paid, for all parents

  • Wellness stipend — $100/month for the gym, therapy, massages, or whatever keeps you human

  • Learning & Development — Expense up to $1,000/year toward anything that helps you grow professionally

  • Team offsites — A change of scenery, minus the trust falls

  • Sabbatical — 3 paid months off after 4 years, do something fun and new

Available to US-based full-time employees
  • Full coverage, no red tape — Medical, dental, and vision (100% for employees, 50% for spouse/kids) — no weird loopholes, just care that works

  • Life & Disability insurance — Employer-paid short-term disability, long-term disability, and life insurance — coverage for life's curveballs

  • Supplemental options — Optional accident, critical illness, hospital indemnity, and voluntary life insurance for extra peace of mind

  • Doctegrity telehealth — Talk to a doctor from your couch

  • 401(k) plan — Retirement might be a ways off, but future-you will thank you

  • Pre-tax benefits — Access to FSAs and commuter benefits to help your wallet out a bit

  • Pet insurance — Because fur babies are family too

Available to SF-based employees
  • SF HQ perks — Snacks, drinks, team lunches, intense ping pong, and peak startup energy

  • E-Bike transportation — A loaner electric bike to get you around the city, on us

Interview Process
  1. Application Review — Send us your work and a quick note on why this excites you. Show us what you've built — eval systems, metrics you designed, datasets you created, quality problems you measured. We care about what you've shipped, not where you went to school.

  2. Intro Chat (~25 min) — A quick conversation to get to know each other before we go deep. We'll talk about what you've been working on, what drew you to Firecrawl, and what you're looking for in your next role. Time for your questions too.

  3. Technical Chat (~45 min) — We'll dig into a real problem from our world — how you'd measure whether messy web output is actually "good," and build the system to prove it. Come ready to think out loud; we care how you reason, not whether you memorized the answer.

  4. Founder Chat (~25 min) — Culture, pace, ownership, and how you like to work. Time for your questions too.

  5. Paid Work Trial (1-2 weeks) — Work with the team on a real, scoped evaluation problem — paid at a contractor rate. It's the truest signal for both sides: you see what building at Firecrawl actually feels like, and we see how you ship. Remote-friendly, and we'll flex around your current commitments.

  6. Decision — We move fast after the trial.

If you care about what "good" actually means and have the engineering depth to measure it, you should join us.

👉 Apply now.

HQ

Firecrawl San Francisco, California, USA Office

San Francisco, CA, United States

Similar Jobs

7 Days Ago
Hybrid
Santa Clara, CA, USA
203K-354K Annually
Senior level
203K-354K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead research in agent learning and recursive self-improvement for enterprise AI agents. Design post-training methods, agent harnesses, training environments, evaluations, and distributed pipelines across language and multimodal systems. Analyze failures, develop training signals, run rigorous experiments, and transition validated improvements into reliable production systems. Collaborate with research, engineering, infrastructure, security, and product teams while communicating results through publications, patents, reports, and open-source work.
Top Skills: DeepspeedFsdpKubernetesMcpMegatronOpenrlhfPythonPyTorchPytorch DistributedRaySglangSlurmTrlVerlVllm
8 Days Ago
Hybrid
Santa Clara, CA, USA
232K-405K Annually
Senior level
232K-405K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead high-impact research in agent learning and recursive self-improvement. Design post-training methods, agent harnesses, training environments, evaluations, and distributed pipelines for reliable enterprise agents. Investigate planning, reasoning, memory, tool use, multimodal capabilities, and long-horizon execution. Analyze failures, run rigorous experiments, build improvement loops, and transition validated research into production systems. Provide technical leadership across teams and communicate results through reports, publications, patents, benchmarks, and open-source contributions.
Top Skills: Distributed InferenceDistributed TrainingDpoGpu InfrastructureGrpoKnowledge RetrievalLarge Language Models (Llms)Model Context Protocol (Mcp)Multimodal ModelsPythonPyTorchReinforcement LearningReward ModelingSupervised Fine-Tuning (Sft)
15 Days Ago
Hybrid
San Francisco, CA, USA
136K-265K Annually
Junior
136K-265K Annually
Junior
Cloud • Healthtech • Social Impact • Software • Biotech
Build datasets, evaluations, and scalable data infrastructure to improve frontier AI models for scientific and biological applications. Analyze model failure modes, run experiments, translate scientific expertise into rigorous evaluation criteria, and collaborate with scientists and AI labs. The role requires working at the intersection of software engineering, biology, and frontier AI in an in-person, fast-paced San Francisco environment.
Top Skills: AIData InfrastructureData PipelinesFrontier ModelsLarge Language Models (Llms)

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account