Security Level 5 Logo

Security Level 5

Machine Learning Research Engineer

Posted One Month Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
200K-350K Annually
Senior level
In-Office
San Francisco, CA, USA
200K-350K Annually
Senior level
Design and run experiments measuring SL5 controls on real ML workflows; forecast 2028 frontier workloads and infrastructure needs; run and interpret scalable experiments to inform a purpose-built, high-assurance datacenter standard for frontier AI.
The summary above was generated by AI

About Security Level 5

Security Level 5 is a Bay Area AI security nonprofit working with AI labs and US intelligence agencies to defend frontier models from priority nation-state-level threats. We move fast, and we're tripling headcount this year.

The Mission

We're hiring for what's plausibly the most difficult, urgent, and interesting challenge in AI security engineering this decade (for humans, at least): designing and building the first datacenter purpose-built to Security Level 5, the standard for defending frontier AI labs against attackers with the resources of a nation-state and billion-dollar budgets. We're working on the first SL5 components this year and aiming for an at-scale SL5 datacenter build in 2027.

We wrote the first version of the standard with input from CISOs and senior security staff at the frontier labs, and US security and intelligence officials. Now we're designing the SL5 architectures purpose-built for frontier AI workloads, and standing up the reference tech stack to guide labs' buildouts. This stack has to hold against nation-states, not destroy researchers' productivity, not cost more than labs can pay, and ship in 2-3 years.

What you'd work on

  • Designing experiments that measure the effect of SL5 controls on real ML research and engineering workflows.

  • Forecasting 2028 frontier workloads (training, inference, fine-tuning, interpretability) and the infrastructure they imply, so controls are evaluated against what labs will actually be doing.

  • Running the experiments at whatever scale is tractable and interpreting them for a frontier-scale audience.

You'd be a fit if you

  • Have trained models at an AI lab or equivalent, and are current on frontier methods and infrastructure.

  • Are comfortable across the training stack: multi-node jobs, accelerators, orchestration, storage, data pipelines.

  • Can design an experiment that answers a question rather than one that produces a number.

  • Are happy working at small scale as a proxy for frontier scale, and can reason about where the proxy breaks.

Logistics

Bay Area, in-person. This role's base salary range is $200,000 - $350,000 USD per year. We may be open to paying exceptional and/or highly experienced employees more than this. We also provide full benefits, including healthcare, dental, vision, 401k match, and more.

Similar Jobs

2 Days Ago
In-Office
San Francisco, CA, USA
Mid level
Mid level
Artificial Intelligence • Biotech
Build and optimize distributed machine learning infrastructure for large-scale model training and inference. Responsibilities include profiling training runs, improving compute, communication, and storage efficiency, developing parallelism and quantization strategies, creating CUDA and Triton kernels, and ensuring fault tolerance, checkpointing, deterministic orchestration, and reliability across GPU clusters. The role partners closely with research scientists to scale new model architectures and training recipes.
Top Skills: CudaDistributed SystemsGpu ClustersJaxPythonPyTorchTriton
10 Days Ago
Remote or Hybrid
San Francisco, CA, USA
165K-310K Annually
Entry level
165K-310K Annually
Entry level
Artificial Intelligence • Machine Learning • Software
Develop and post-train deep learning models while building systems, tooling, and workflows for training, evaluation, debugging, and deployment. Contribute to open-source projects, distributed AI infrastructure, backend services, and developer platforms. Collaborate with research, product, infrastructure, and customer teams to solve complex technical problems, prototype ideas, and productionize successful experiments.
Top Skills: Cloud InfrastructureCudaDeepspeedDistributed SystemsFsdpHugging FaceLightning AiNvidia MoltPyTorchSglangTritonVllm
11 Days Ago
In-Office
San Francisco, CA, USA
Senior level
Senior level
Artificial Intelligence • Logistics • Machine Learning • Software
Develop and productionize machine learning models for supply chain forecasting and optimization. Responsibilities include creating model architectures, curating proprietary real-world data, integrating LLM reasoning and tool use, designing evaluations, and continuously improving performance as market conditions change. The role owns the full research cycle from hypothesis through production and requires collaboration in a fast-moving, in-person environment.
Top Skills: Large Language Models (Llms)Machine LearningMathematical ModelingOptimizationTime-Series Forecasting

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account