As a machine learning engineer within the Attributes team in the Perception department, you will take ownership of developing and enhancing sophisticated behavioral models for various road users, including vehicles, pedestrians, and cyclists. Your work will focus on creating and maintaining robust perception attribute models that generate critical signals for our autonomous driving stack. These signals are essential inputs that enable our Prediction and Planning teams to make intelligent, safe driving decisions for our autonomous vehicles.
In this role, you will...
- Lead the development of sophisticated behavioral models for vehicles, pedestrians, and cyclists as a key member of the Attributes team within Zoox's Perception department.
Create and maintain perception attribute models that generate essential signals, enabling our autonomous vehicles to understand and predict the behavior of various road users.
You will collaborate closely with Prediction and Planning teams to optimize your models' outputs, directly influencing how our autonomous vehicles make real-time driving decisions.
Work with data labeling and ontology teams on data labeling and ontology definitions of the road users in different attributes and generate auto-labeling or data mining strategies for different attributes.
You will help shape the future of autonomous mobility by bridging the critical gap between raw perception data and autonomous decision-making.
Qualifications:
MS/PhD in computer science or related fields with a minimum of 7 years of relevant experience
Experience with training and deploying Deep Learning models
Experience with knowledge distillations from large foundation models
Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
Fluency programming in Python and extensive experience with algorithm design
Strong mathematics skills
Bonus Qualifications
Familiarity of VLMs/VLAs/ViTs
Experience with large model distillation in a production environment
Familiarity with C++
Zoox Foster City, California, USA Office
4000 E 3rd Ave, Foster City, CA, United States, 94404
Zoox Foster City, California, USA Office
1149 Chess Drive, Foster City, CA, United States, 94404
Zoox Fremont, California, USA Office
47540 Kato Road, Fremont, CA, United States, 94538
Zoox San Francisco, California, USA Office
60 Broadway St, San Francisco, CA, United States, 94111
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
