Design and develop auto-labeling algorithms for autonomous driving, collaborating with ML engineers to enhance data quality and efficiency in model training.
As a Perception Engineer, you will be instrumental in designing and implementing cutting-edge detection models, utilizing fused sensor data. In particular, the role will be on advanced projects that are aimed at the next generation of driving software, including looking at joint detection and tracking models as well as ways to send rich embeddings to downstream models to relay semantic meaning and capture uncertainty.
This role offers a unique opportunity to directly impact Zoox's expansion into new areas. By developing more generalizable and adaptable models, you will help us navigate diverse and challenging circumstances, accelerating our mission to deliver safe and reliable autonomous mobility. We are looking for a highly motivated individual passionate about pushing the boundaries of perception in the autonomous vehicle space.
In this role, you will:
- Train ML models, perform various studies into incorporating SOTA approaches as well as ablations/modifications of existing models
- Document experimental outcomes and drive towards deploying these models into Zoox robots
- Visualize your data at the input and output to understand the issues
- Collaborate with teams such as ML optimization, data labeling, metrics and planner to ensure project is successful for Zoox releases
Qualifications
- MS/PhD in Computer Science or related field
- Experience with PyTorch or related ML frameworks
- Experience deploying learned models into production
- Excellent collaboration and teamwork skills with proven track record of working on large-scale problems
Bonus Qualifications
- Prior experience in the AV or related space with joint detection and tracking models
- Deep understanding of how to setup end-to-end training and evaluation processes
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to [email protected] or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
Top Skills
Data Management Tools
Ray
Zoox Foster City, California, USA Office
4000 E 3rd Ave, Foster City, CA, United States, 94404
Zoox Foster City, California, USA Office
1149 Chess Drive, Foster City, CA, United States, 94404
Zoox Fremont, California, USA Office
47540 Kato Road, Fremont, CA, United States, 94538
Zoox San Francisco, California, USA Office
60 Broadway St, San Francisco, CA, United States, 94111
Similar Jobs
Artificial Intelligence • Machine Learning • Robotics • Software • Transportation • Design • Manufacturing
Lead the development of machine learning algorithms focusing on perception for autonomous driving, collaborating across teams and mentoring ML developers.
Top Skills:
C++Deep LearningMachine LearningPython
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Senior Manager, Portfolio Sourcing will lead sourcing efforts, manage vendor relationships, negotiate contracts, and ensure alignment with Pfizer's R&D portfolio strategies.
Top Skills:
Contract NegotiationFinancial ModelingSourcing Strategies
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Global Development Lead manages clinical development for assigned assets, leads cross-functional teams, oversees regulatory submissions, and provides expertise in therapeutic areas. Responsibilities include developing clinical plans, partnering with trial clinicians, and ensuring compliance with regulations.
Top Skills:
Clinical DevelopmentDigital InnovationProject ManagementRegulatory Submissions
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

