Cursor Logo

Cursor

Software Engineer, RL Data

Posted 22 Days Ago
In-Office
Palo Alto, CA, USA
Entry level
In-Office
Palo Alto, CA, USA
Entry level
Build systems and data pipelines for reinforcement-learning training of coding agents. Responsibilities include creating verifiable tasks, production-like environments, graders, automated quality checks, and scalable evaluation systems. Investigate model weaknesses through hypotheses, ablations, rollout analysis, and aggregate metrics to improve training data quality and model performance.
The summary above was generated by AI

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.
SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.

Software Engineer, RL Data

About the Role

The data behind a model shapes it more than almost anything else. On the RL Data team at SpaceXAI, you decide what that data is for our agents: which problems they practice, what world they practice in, and how they're judged. You'll take a weakness, like an agent that gives up on hard bugs or misuses a calendar API, and turn it into training data that fixes it, then show the next model is measurably better.

You form hypotheses about why data is helping or misleading the model, build the systems to test them, run ablations, and read the rollouts to find the bug, shortcut or mismatch behind a result. Every flaw you catch, or miss, shows up in what the next Grok models learn.

What you’ll work on
  • Turning a capability gap into thousands of verifiable tasks — for example, planting subtle bugs deep in a real project's dependencies for the agent to root-cause.

  • Building environments that behave like production: real codebases with their real dependencies, and simulations of apps like email, calendar, and docs that match the real ones down to search, errors, and pagination.

  • Designing graders for open-ended work that separate good solutions from bad without penalizing valid alternatives or rewarding shortcuts.

  • Building automated checks that catch reward hacking, leaked answers, broken environments, and paths the real product wouldn't allow, before data reaches training.

  • Scaling from a thousand hand-checked tasks to millions, with filters and judges you can trust in place of a person reading each one

You may be a fit if
  • You have strong software engineering fundamentals, and you've built non-trivial systems in Python: data pipelines, test or eval infrastructure, sandboxes, or backend services.

  • You have taste for what makes an environment trustworthy: faithful enough that skills transfer, strict enough that shortcuts fail, and simple enough to debug when a result looks wrong.

  • You are careful and systematic — understanding both aggregate metrics and close reading of raw outputs.

  • You enjoy turning messy, open-ended problems into repeatable, high-quality data production systems.

  • RL or ML experience is a plus but not required. We welcome strong engineers who want to do research on what makes models better.

Applying

If there appears to be a fit, we'll reach out to schedule 2-3 short technicals. After, we'll schedule an onsite in our office, where you'll work on a small project, discuss ideas, and meet the team.

Cursor San Francisco, California, USA Office

San Francisco, CA, United States

Similar Jobs

4 Minutes Ago
Hybrid
Sunnyvale, CA, USA
120K-185K Annually
Senior level
120K-185K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead backend engineering for authentication and authorization services operating at extreme scale. Design distributed cloud systems, APIs, storage, and scalable architectures handling billions of authorization decisions and millions of events per second. Collaborate across teams, mentor developers, improve performance and reliability, contribute to open source, and apply AI technologies to enhance workflows and decision-making.
Top Skills: AWSElasticsearchGCPGitGoGrpcJwtKafkaOauthOidcOpenfgaPostgresRedisSAMLSpicedbSsoZanzibar
4 Minutes Ago
Remote or Hybrid
Sunnyvale, CA, USA
120K-185K Annually
Entry level
120K-185K Annually
Entry level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Develop and maintain CrowdStrike’s macOS endpoint security sensor using C/C++ and Swift. Design, implement, and own features across operating-system subsystems including filesystems, memory, processes, and networking. Build reliable, high-performance, multithreaded software, troubleshoot customer-reported issues, collaborate with distributed teams, and use AI technologies to improve workflows and decision-making.
Top Skills: CC++CybersecurityEndpoint ProtectionLinuxmacOSMultithreadingNetworking ProtocolsSwiftWindows
4 Minutes Ago
Hybrid
Sunnyvale, CA, USA
160K-260K Annually
Senior level
160K-260K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design and develop high-reliability, highly concurrent Linux security sensor software for large-scale environments. Lead technical proposals, design reviews, planning, debugging, incident resolution, testing improvements, and cross-team architecture discussions. Mentor junior engineers, communicate technical tradeoffs, and influence engineering direction. Work across kernel, memory, process, filesystem, and networking subsystems, with opportunities to use eBPF and endpoint security technologies.
Top Skills: CC++EbpfLinuxLinux KernelMultithreading

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account