Zoox Logo

Zoox

Machine Learning Engineer - 3D Vision Perception

Posted 16 Hours Ago
Be an Early Applicant
Hybrid
Foster City, CA
189K-258K Annually
Senior level
Hybrid
Foster City, CA
189K-258K Annually
Senior level
The role involves designing and training ML models for sensor fusion, optimizing for deployment, and collaborating with teams to enhance perception capabilities for autonomous vehicles.
The summary above was generated by AI
The Perception team is responsible for fusing sensor data from multiple modalities and producing relevant representations for difficult and unstructured obstacles around the vehicle. We’re looking for someone with deep machine learning experience that can help with all stages of the model development lifecycle, including training, evaluation, and deployment.

In this role, you will:

  • Design, develop, train and evaluate multi-sensor fusion based deep learning models to understand obstacles and environmental context

  • Understand and curate real and synthetic datasets to improve our models

  • Perform latency optimization and deploy models to our robot fleet

  • Build a deep understanding of Perception gaps and behavioral issues around difficult obstacle types in order to help plan and prioritize our work

  • Collaborate with Prediction/Planner team to deploy fully autonomous vehicles in environments with difficult and rare obstacles, extreme weather conditions, and complex driving scenarios

Qualifications:

  • 5 years of industry experience or more

  • Proficiency in Python and some knowledge in C++

  • Deep Learning expertise, preferably with panoptic segmentation experience

  • Experience developing multi-sensor fusion algorithms for object detection, panoptic segmentation or object tracking

  • Familiar with Transformer architecture

Bonus Qualifications:

  • Technical leadership experience with software or machine learning teams

  • TensorRT or CUDA experience

  • Experience of 3DGS for 3D reconstruction or novel view synthesis

About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.

Follow us on LinkedIn

Accommodations
If you need an accommodation to participate in the application or interview process please reach out to [email protected] or your assigned recruiter.

A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

Top Skills

C++
Cuda
Deep Learning
Python
Tensorrt
HQ

Zoox Foster City, California, USA Office

4000 E 3rd Ave, Foster City, CA, United States, 94404

Zoox Foster City, California, USA Office

1149 Chess Drive, Foster City, CA, United States, 94404

Zoox Fremont, California, USA Office

47540 Kato Road, Fremont, CA, United States, 94538

Zoox San Francisco, California, USA Office

60 Broadway St, San Francisco, CA, United States, 94111

Similar Jobs

23 Minutes Ago
In-Office
5 Locations
115K-168K Annually
Senior level
115K-168K Annually
Senior level
Cloud • Information Technology • Machine Learning
The Senior Marketing Manager will lead regional go-to-market programs, managing events and strategies to drive pipeline and revenue in the Americas market.
Top Skills: Abm PlatformMarketing AutomationSalesforce
23 Minutes Ago
In-Office
5 Locations
115K-168K Annually
Senior level
115K-168K Annually
Senior level
Cloud • Information Technology • Machine Learning
In this role, you will lead the design and execution of global executive programs, focusing on VP and C-Suite engagement, while collaborating cross-functionally to drive program success.
23 Minutes Ago
In-Office
5 Locations
98K-143K Annually
Senior level
98K-143K Annually
Senior level
Cloud • Information Technology • Machine Learning
The Front End Web Developer will build and maintain web experiences using Webflow and WordPress, translating design into high-quality implementations while collaborating with various teams to ensure performance and usability.
Top Skills: Ai-Powered ToolsCSSFigmaGa4Google OptimizeHTMLJavaScriptTag ManagerTechnical SeoWebflowWordpress

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account