Polished Snow Logo

Polished Snow

Research Engineer, ML Infrastructure

Posted 3 Days Ago
In-Office
Palo Alto, CA, USA
150K-220K Annually
Entry level
In-Office
Palo Alto, CA, USA
150K-220K Annually
Entry level
Build and own ML infrastructure for distributed training across GPU clusters, including job launching, checkpointing, recovery, monitoring, profiling, experiment tooling, and reliable data pipelines. Debug failures across GPUs, networking, numerics, and data while partnering closely with research. The role suits an early-career builder with strong Python skills, practical ML tooling experience, public work, high agency, and a willingness to learn quickly in a small, autonomous team.
The summary above was generated by AI
Who we are

Polished Snow is an AI lab building energy-based reasoning models for critical systems. Power grids, industrial infrastructure, the technology the world runs on.

Most AI models are built to generate a plausible answer. Our model, Case, is built to know when an answer is wrong before it becomes one. It scores, refines and verifies a plan against the full system until it holds. That difference matters enormously when the cost of being wrong is high.

We are a small, funded team and we are just getting started.

What we're looking for

A Research Engineer, ML Infrastructure who thinks from first principles and builds things that work outside the lab. You care about why people want something and why models behave the way they do, and you care that what we ship works when it actually matters. If you have built products, shipped software, talked to customers or run outreach, and you are drawn to the hardest reliability problems in AI, this is the role.

This is a role for someone early in their career who has already built real things. We care more about how fast you have been learning than where you have been.

What you'll do
  • Build and own distributed training systems across GPU clusters. Job launchers, checkpointing, recovery and monitoring should keep experiments moving when something fails.

  • Profile training end to end. Find bottlenecks in data loading, communication, memory and compute, then fix the ones that matter.

  • Build the tooling to launch, track and compare experiments. Make runs reproducible and shorten the path from an idea to a result.

  • Build reliable data pipelines for training and evaluation. Own data quality, throughput and the ability to reproduce a run.

  • Debug failures across GPUs, networking, numerics and data. Build systems that recover cleanly instead of leaving researchers to start over.

  • Implement and tune distributed parallelism where it helps. Understand the hardware and the tradeoffs rather than treating the training stack as a black box.

  • Work directly with research to build infrastructure before it becomes a bottleneck. You own the systems from the cluster to the training loop.

How we work

We are a small team with a high bar and very little process. You get a real problem and the trust to go after it, and you decide how it gets solved. We think carefully and move fast.

When you build something here, you own it. The system, the results, and what happens when it breaks. Nobody else is going to pick it up for you.

Who you are
  • A builder with public work to show. Repos, hardware, a product, a paper, a competition result, a project or company you ran at school. We will read it, so make it good.

  • High agency. You want to build a company from the ground up. You start things without being asked, you finish them, and you take 100% ownership of the systems you build.

  • Tapped in. You know what is happening in the tech ecosystem around you and around the world. You spend time on X, you follow what people are building, and you know and connect with the people doing it.

  • Comfortable working from first principles. You can define a problem, talk to the people who have it, and build the minimal system that proves what is possible.

  • You care how and why models work, and you care that they actually work when the stakes are real.

  • Fast to learn. Your last year looks very different from the year before it.

  • Solid in Python and at home with ML tooling. You do not have to be a researcher.

  • You thrive in small, focused teams that value autonomy, speed and tight collaboration over process.

  • You think AI for critical systems is one of the most consequential problems in the field right now and you want to be early to solving it.

  • Students and recent graduates are welcome. We do not require a degree or a set number of years of experience.

The bar

We want to work with people who want to be among the best in the world at what they do. If that sounds like you, we want to hear from you.

How to apply

Send us your best work. Tell us about the coolest thing you have built end to end and what you learned fastest in the last year. Add your X and your website if you have them.

Similar Jobs

One Month Ago
In-Office
San Francisco, CA, USA
Mid level
Mid level
Artificial Intelligence • Biotech
Build and optimize distributed machine learning infrastructure for large-scale model training and inference. Responsibilities include profiling training runs, improving compute, communication, and storage efficiency, developing parallelism and quantization strategies, creating CUDA and Triton kernels, and ensuring fault tolerance, checkpointing, deterministic orchestration, and reliability across GPU clusters. The role partners closely with research scientists to scale new model architectures and training recipes.
Top Skills: CudaDistributed SystemsGpu ClustersJaxPythonPyTorchTriton
2 Months Ago
In-Office
San Francisco, CA, USA
350K-500K Annually
Senior level
350K-500K Annually
Senior level
Artificial Intelligence • Natural Language Processing • Generative AI
Build and scale infrastructure and data pipelines for Safeguards ML research. Own training, evaluation, and scoring workflows, design researcher-facing tooling, ensure correctness and reliability, productionize high-value research workflows, and improve throughput, cost, and reliability of large-scale inference and scoring workloads while partnering with researchers.
Top Skills: Python
3 Months Ago
In-Office
San Francisco, CA, USA
Mid level
Mid level
Artificial Intelligence • Software
The Research Engineer, Infrastructure will build distributed training systems, optimize performance, manage data pipelines, and enhance research workflows, ensuring the infrastructure scales with AI advancements.
Top Skills: C++GpuPythonPyTorch

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account