Workshop Labs Logo

Workshop Labs

Machine Learning Infrastructure Engineer

Reposted One Month Ago
In-Office
San Francisco, CA, USA
Mid level
In-Office
San Francisco, CA, USA
Mid level
Build and optimize infrastructure for private, personal AI models, ensuring performance and privacy while deploying at scale.
The summary above was generated by AI

Build the infrastructure to serve personal AI models privately and at scale.

We're building the first truly private, personal AI – one that learns your skills, judgment, and preferences without big tech ever seeing your data.

Our core ML systems challenge: how do we serve the world’s best personal model, at low cost and high speed, with bulletproof privacy?

What you'll do

• Build the infrastructure that lets us create & deploy thousands and eventually millions of personalized finetuned models for our customers

• Monitor & optimize in-the-wild model serving performance to hit low latency & cost

• Interface with the TEE-based privacy stack that lets us guarantee user data & models can only be seen & used by the user—not even us—and integrate the privacy architecture with the finetuning & inference code

You have

A deep understanding of the machine learning stack. You can dive into the details of how transformers work & performance optimization techniques for them. You have a mental model of GPUs sufficient to reason about performance from first principles. You can drill down from ML code to metal.

Ability to execute quickly. We ship fast and fail fast so we can win faster. The challenge of human relevance in a post-AGI world isn’t going to solve itself.

A missionary mentality. We’re a mission-driven company, looking for mission-first people. If you’re passionate about ensuring AI works for people (and not the other way around), you’ve come to the right place.

Ready to roll up your sleeves. We're an early stage startup, so we’re looking for someone who can wear many hats.

Experience you may have

• Work at a fast-paced AI startup, or top AI lab.

Experience deploying ML systems at scale. You might have worked with frameworks like vLLM, S-LoRA, Punica, or LoRAX.

Experience with privacy-first infrastructure. You’re familiar with confidential computing & ability to reason about both technical and real-world confidentiality and security. You may have worked with secure enclaves, TEEs, code measurement & remote attestation, Nvidia Confidential Computing, Intel TDX or AMD SEV-SNP, or related confidential computing technologies.

We encourage speculative applications; we expect many strong candidates will have different experience or unconventional backgrounds.

What we offer

• Generous compensation and early stage equity. We’re competitive with the top startups, because we believe the best talent deserves it.

World-class expertise. We’re based in top AI research hubs in San Francisco and London. We're backed by AI experts like Juniper Ventures, Seldon Lab, and angels at Anthropic and Apollo Research. You’ll have access to some of the best AI expertise in the world.

Massive impact. Our mission is to keep people in the economy well after AGI. You’ll help shift the trajectory of AI development for the better, helping break the intelligence curse and prevent gradual disempowerment to keep humans in control of the future.

About Workshop Labs

We’re building the AI economy for humans. While everyone else tries to automate the world top-down, we believe in augmenting people bottom-up.

Our team previously created evals used by Open AI, completed frontier AI research at MIT/Cambridge/Oxford, worked in Stuart Russell's lab, and led product verticals at high growth startups.

Our founders' essay series on AI’s economic impacts and the technology we’ll need to keep humans relevant, The Intelligence Curse, has been covered in TIME, The New York Times, and AI 2027.

Our vision is for everyone to have a personal AI aligned to their goals and values, helping them stay durably relevant in a post-AGI economy. As a public benefit corporation, we have a fiduciary duty to ensure that as AI becomes more powerful, humans become more empowered, not disempowered or replaced.

We’re an early stage startup, backed by legendary investors like Brad Burnham and Matt McIlwain, visionary product leaders like Jake Knapp and John Zeratsky, philosopher-builders like Brendan McCord, and top AI safety funds like Juniper Ventures. Our investors were early at Anthropic, Slack, Prime Intellect, DuckDuckGo, and Goodfire. Our advisors have held senior roles at Anthropic, Google DeepMind, and UK AISI.

Similar Jobs

6 Days Ago
Hybrid
Palo Alto, CA, USA
Senior level
Senior level
Financial Services
Designs, builds, and operates secure, scalable cloud and GPU infrastructure platforms for enterprise AI/ML workloads. Leads architecture, production coding, Kubernetes and container operations, CI/CD, infrastructure automation, performance optimization, and reliability efforts. Partners with AI/ML and platform teams to support distributed multi-GPU training and inference. Provides technical leadership while advancing responsible AI-assisted engineering, secure SDLC practices, automation, and operational excellence.
Top Skills: BcmC#Ci/CdCloud InfrastructureCudaDistributed SystemsDockerGoGpu InfrastructureJavaKubernetesLinuxMicroservicesMlflowNvidia DcgmNvidia DriversPythonRay.IoSlurm
16 Days Ago
Hybrid
Palo Alto, CA, USA
133K-235K Annually
Junior
133K-235K Annually
Junior
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Build and optimize large-scale machine learning infrastructure for content retrieval and recommendation. Responsibilities include developing feature generation and serving pipelines, high-performance inference systems, cloud-based training and evaluation infrastructure, and data management systems. The role partners with ML engineers to deploy models, improve reliability and efficiency, and operate highly available distributed systems using Java, Go, C++, and Python.
Top Skills: C++Caffe2FlinkGoJavaPythonPyTorchRayScikit-LearnSparkSpark MlTensorFlow
18 Hours Ago
Hybrid
Sunnyvale, CA, USA
170K-241K Annually
Senior level
170K-241K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Design and build scalable, reliable ML training infrastructure for advanced AI research and model development. Optimize distributed training performance, resource utilization, data loading, and costs across heterogeneous GPU and cloud environments. Improve platform observability, debuggability, operational excellence, and user experience. Collaborate with ML engineers, research scientists, and cross-functional partners to integrate new technologies supporting intelligent driving systems.
Top Skills: AWSAzureDistributed ComputingFsdpGCPGpu ComputingPipeline ParallelismPythonPyTorchTensorFlow

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account