Lead a team in developing and deploying multi-modal large language models for autonomous driving applications, focusing on optimization techniques and internal customer solutions.
Zoox is developing the first fully autonomous, purpose-built electric vehicle designed for autonomous ride-hailing. We are a passionate, collaborative, and fast-moving team working to build a revolutionary new mobility experience. This role offers the opportunity to make critical contributions to a challenging and groundbreaking product.
Zoox is seeking an experienced Manager of Multi-Modal LLM Applications to lead a team focused on applying cutting-edge Large Multi-Modal Models (MLLMs) to solve concrete, offline autonomy problems. This role is crucial for deploying state-of-the-art AI into our autonomous driving platform, directly impacting the safety and performance of our technology.
In this role, you will:
- Leadership: Lead and manage a team of talented Machine Learning Engineers specializing MLLMs for concrete applications.
- Model Development & Deployment: Oversee the full lifecycle of MLLM development, with a specific focus on post-training methodologies (e.g., fine-tuning, RLHF, context engineering) to optimize models for autonomy tasks.
- Internal Customer Focus: Drive the deployment of complex MLLM solutions to internal customers, specifically solving tangible offline autonomy problems within the Zoox ecosystem.
- Cross-Functional Strategy: Understand and identify dependencies between your team's work and other engineering teams and domains (e.g., Perception, Prediction, Planning, Validation). Collaborate with functional peer managers to ensure alignment and cooperation.
- People Management & Development: Proactively create development opportunities for team members, coaching and mentoring them to grow their technical and leadership skills. Estimate staffing needs and schedules and assign project work to drive efficiency and meet operational goals.
- Operational Execution & Problem Solving: Establish team goals and priorities and execute against operational needs. Apply and improve upon existing processes and procedures to resolve functional problems for the team.
- Identify issues, gather facts, and execute analysis of situations or data to inform strategy and decisions.
- Accountability & Influence: Your decisions will have a lasting impact on the success of the team and department. You will be responsible for managing special projects and initiatives and will frequently conduct presentations of key information to gain the cooperation of others.
- Strategic Influence: Leverage broad knowledge of the specialized field/discipline to analyze complex information. Recommend and collaborate with senior management to resolve strategic issues. This role may involve leading a medium-to-large team, including direct reports who are also managers.
Qualifications
- 5+ years of professional experience in Machine Learning or Deep Learning, with a focus on large-scale model applications.
- 3+ years of experience leading and managing engineering or research teams focused on AI/ML.
- Direct experience leading teams training Multi-Modal Large Language Models (MLLMs), with deep expertise in post-training techniques (e.g., instruction tuning, alignment, domain adaptation).
- Proven track record of deploying ML/MLLM models to production or internal customers to solve complex, real-world problems, ideally within the autonomy or robotics domain.
- Strong organizational skills to manage complex project schedules, staffing needs, and priorities effectively.
- A passion for mentoring and developing high-performing team members.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to [email protected] or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
Top Skills
Context Engineering
Deep Learning
Fine-Tuning
Machine Learning
Multi-Modal Large Language Models
Reinforcement Learning
Zoox Foster City, California, USA Office
4000 E 3rd Ave, Foster City, CA, United States, 94404
Zoox Foster City, California, USA Office
1149 Chess Drive, Foster City, CA, United States, 94404
Zoox Fremont, California, USA Office
47540 Kato Road, Fremont, CA, United States, 94538
Zoox San Francisco, California, USA Office
60 Broadway St, San Francisco, CA, United States, 94111
Similar Jobs
Fintech • Payments • Financial Services
The Head of Developer Relations will enhance the developer experience by leading strategy, managing a team, and facilitating community engagement to drive product impact.
Top Skills:
APIsDeveloper ToolsProgramming LanguagesSdks
Fintech • Payments • Financial Services
Lead developer advocacy efforts, enhance developer experience, manage a team, and foster community engagement while collaborating across engineering and product teams.
Top Skills:
APIsSdks
eCommerce • Mobile • Payments
As a Senior Account Manager, you will own client relationships, drive revenue growth, lead campaign execution, and identify strategic upsell opportunities, with a focus on maximizing ROI and client retention.
Top Skills:
ExcelGoogle SuiteLookerPowerPoint
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine


