Zoox Logo

Zoox

Senior/Staff Software Engineer - Perception & Sensing

Posted 22 Days Ago
Be an Early Applicant
Hybrid
Foster City, CA, USA
242K-333K Annually
Senior level
Hybrid
Foster City, CA, USA
242K-333K Annually
Senior level
Drive architectural design and evaluation of the PCP stack for vehicle platforms, focusing on sensors in adverse conditions, with responsibilities including executing validation pipelines and designing experiments.
The summary above was generated by AI
The Perception Sensing team is looking for a Senior or Staff Software Engineer to drive the evaluation and architectural design of our PCP stack for future vehicle platforms enabling winter driving and low cost vehicle platforms. This team acts as the bridge between Perception Software and Autonomous Hardware Engineering (AHE). We ensure that as Zoox evolves toward future platforms, every sensor change across all modalities (Lidar, Radar, Camera etc) is validated with mathematical rigor. The role focuses on executing the technical validation pipeline and experimental design across the entire sensor suite.

Responsibilities

  • Execute the PCP metrics pipeline, assessing how hardware updates across various sensors impact PCP performance sensitivity in 3D scene understanding, live mapping and localization, especially in adverse weather and winter conditions.

  • Design and run structured A/B testing experiments, including side-by-side custom mount runs and tandem vehicle data collection, to clear sensors for the winter ODD.

  • Collaborate with AHE to correlate sensor-specific lab tests (e.g., heater/defroster impacts on camera lenses, snow accumulation on radomes) to downstream PCP performance.

  • Root cause detection regressions to understand how early fusion models compensate for modality degradation in challenging environments.

  • Design & develop performant and efficient multi-sensor fusion model to leverage the complementary advantage of on-board (low cost) sensors to improve Perception performance for highway and adverse weather.

Qualifications

  • Strong C++ and Python for running and modifying PCP metrics pipelines, automated testing, and re-simulations.

  • Experience with A/B testing methodology (RBV - Risk Balanced Verification) for evaluating hardware/software changes in varied environments.

  • Familiarity with diverse perception outputs and how environmental factors (like snow or fog) degrade bounding box precision/recall, point clouds, and 3D occupancy.

  • Ability to define complex data collection plans for winter ODDs (e.g., specific snow types, ice, low temperatures).

  • Experience with designing, developing and deploying multi-modality fusion based Perception models for 3D object detection, 3D segmentation & occupancy, Mapping and Localization. 

Bonus Qualifications

  • Experience in performance optimization to fit complex ML stack to low-power low cost edge compute (e.g., Nvidia Thor, TensorRT optimization).

  • Experience with designing better sensor or better ML model for an anomaly or rare event/objects detection

HQ

Zoox Foster City, California, USA Office

4000 E 3rd Ave, Foster City, CA, United States, 94404

Zoox Foster City, California, USA Office

1149 Chess Drive, Foster City, CA, United States, 94404

Zoox Fremont, California, USA Office

47540 Kato Road, Fremont, CA, United States, 94538

Zoox San Francisco, California, USA Office

60 Broadway St, San Francisco, CA, United States, 94111

Similar Jobs

11 Days Ago
Hybrid
Foster City, CA, USA
324K-389K Annually
Senior level
324K-389K Annually
Senior level
Artificial Intelligence • Machine Learning • Robotics • Software • Transportation • Design • Manufacturing
The Software Engineer will develop algorithms and code related to AI, robotics, and sensing technologies, impacting key systems at Zoox.
Top Skills: C/C++Computer VisionMachine LearningNeural Networks
41 Minutes Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
141K-169K Annually
Senior level
141K-169K Annually
Senior level
eCommerce • Healthtech • Kids + Family • Retail • Social Media
The Senior Manager, Planning will oversee financial and inventory strategies for a division, leading forecasting and management while partnering with various cross-functional teams for improved business decisions.
Top Skills: Advanced ExcelAnaplanNetSuiteSAP
2 Hours Ago
Hybrid
2 Locations
230K-286K Annually
Senior level
230K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The role involves designing, developing, and supporting AI software components, leveraging various AI technologies, and optimizing performance for large-scale AI systems.
Top Skills: AWSAzureGoGCPHuggingfaceJavaNemo GuardrailsPythonPyTorchScalaVectordbs

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account