Develop and train models for sensor-level scenario generation using deep learning and multi-sensor fusion for autonomous vehicle perception at Zoox.
The Perception team at Zoox is at the forefront of leveraging GenAI to create synthetic data, unlocking scalable training and evaluation for our autonomous system's perception and entire stack. As a Generative AI Engineer, you will develop and train cutting-edge models for sensor-level scenario generation, utilizing world models and radiance fields techniques with large-scale proprietary data. This role directly impacts the productivity, safety, and capabilities of Zoox's autonomous system by validating algorithms in real-world conditions.
In this role, you will:
- Design, develop, train and evaluate multi-sensor fusion based deep learning models to understand obstacles and environmental context
- Understand and curate real and synthetic datasets to improve our models
- Perform latency optimization and deploy models to our robot fleet
- Build a deep understanding of Perception gaps and behavioral issues around difficult obstacle types in order to help plan and prioritize our work
- Collaborate with Prediction/Planner team to deploy fully autonomous vehicles in environments with difficult and rare obstacles, extreme weather conditions, and complex driving scenario
Qualifications
- MS or PhD in Computer Science, Machine Learning, or related technical field with 5+ years of industry experience
- Proficiency in Python and some knowledge in C++
- Deep Learning expertise
- Experience developing multi-sensor fusion algorithms for object detection, panoptic segmentation or object tracking
- Familiar with Transformer architecture
Bonus Qualifications
- Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
- Experience with autonomous robotics systems
- Experience implementing 3D Gaussian Splatting
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to [email protected] or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
Zoox Foster City, California, USA Office
4000 E 3rd Ave, Foster City, CA, United States, 94404
Zoox Foster City, California, USA Office
1149 Chess Drive, Foster City, CA, United States, 94404
Zoox Fremont, California, USA Office
47540 Kato Road, Fremont, CA, United States, 94538
Zoox San Francisco, California, USA Office
60 Broadway St, San Francisco, CA, United States, 94111
Similar Jobs
Artificial Intelligence • Automotive • Machine Learning • Transportation
Lead the development of advanced perception algorithms for self-driving vehicles. Collaborate and mentor engineers, optimize algorithms, and implement sensor fusion for robust perception systems.
Top Skills:
C++CudaDeep LearningMachine LearningPythonPyTorchTensorFlow
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
The Associate Flight Operations Generalist - Dispatcher applies policies and regulations to support flight operations, manage requirements, and coordinate departmental activities under general supervision.
Top Skills:
Faa RulesFlight Operations System
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
The Electrophysics Engineer will support testing and validation of radar technologies, maintenance of radar systems, and design future radar applications, working in an agile team environment.
Top Skills:
BashCC++CstFekoHfssJavaLinuxMatlabPerlPythonPython
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
