Senior Research Scientists work on deriving probabilistic ML theory, scaling experimentation, implementing models, publishing findings, and creating production models. They collaborate with researchers and engineers and must become experts in various fields.
Overview
Extropic’s hardware massively accelerates certain kinds of probabilistic inference. Our ML team works on the science of training models in the thermodynamic paradigm, and we are looking for senior research and engineering talent to derive probabilistic ML theory, empirically demonstrate its scaling properties, and deploy performant models. Senior hires will be leading their own research direction and are therefore expected to quickly become experts across our abstraction stack, including the hardware, software, physics, and math.
Responsibilities
- Collaborate with senior researchers, residents, engineers, and physicists to derive the theory of new probabilistic models and their learning rules, including energy-based models and diffusion models.
- Scale up experimentation infrastructure and optimize over the design space of models.
- Implement, visualize, and evaluate new architectures, training algorithms, and benchmarks.
- Publish papers, contribute to open source, and communicate design insights to our hardware team.
- Create production models for domain experts using customer data.
Required Qualifications
- Experience in scientific Python and at least one deep learning framework (PyTorch, JAX, TensorFlow, Keras)
- Extremely strong foundations in probability and linear algebra
- Familiarity with deep learning theory and literature, including theory of over-parameterization and scaling laws
- Publications in top ML conferences (NeurIPS, ICML, ICLR, CVPR)
- Experience training high-performance models, including familiarity with infrastructure (Slurm, Ray, Weights & Biases)
- Experience deploying models, including familiarity with infrastructure (Ray, AWS, ONNX)
Preferred Qualifications
- Experience designing probabilistic graphical models (PGM)
- Experience training energy-based models (EBMs) or diffusion models
- Experience with numerical methods in diffeq solvers
- Experience with message passing or training graph neural networks (GNNs)
- Strong theoretical background in information geometry
- Strong theoretical background in random matrix theory
- Strong grasp of computational Bayesian methods, including MCMC sampling methods and variational inference
Extropic is an equal opportunity employer
Top Skills
AWS
Jax
Keras
Onnx
Python
PyTorch
Ray
Slurm
TensorFlow
Weights & Biases
Similar Jobs
Artificial Intelligence • Information Technology • Robotics • Software
The role involves designing robot learning algorithms, leveraging data for generalizable behaviors, and collaborating on consumer robot development. Responsibilities include end-to-end task management from definition to deployment.
Top Skills:
PythonPyTorch
Artificial Intelligence • Biotech
Lead development of scalable molecular dynamics pipelines, integrating physics-based models with machine learning frameworks to enhance molecular engineering and experimentations.
Top Skills:
JaxPythonPyTorch
Artificial Intelligence • Biotech
The ML Research Scientist will design Bayesian optimization frameworks, collaborate with lab scientists, and integrate ML models with experimental data.
Top Skills:
BotorchPyroPythonPyTorch
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
