Woven by Toyota Logo

Woven by Toyota

Lead Perception Engineer

Reposted 23 Days Ago
Be an Early Applicant
Hybrid
Palo Alto, CA, USA
161K-265K Annually
Senior level
Hybrid
Palo Alto, CA, USA
161K-265K Annually
Senior level
Lead the development of a perception system for autonomous driving, mentor engineers, manage ML model projects, and ensure agile practices.
The summary above was generated by AI
Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.

Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.

TEAM
At Woven by Toyota, we work on some of the most challenging problems in autonomy from 3D geometric computer vision and perception to prediction, motion planning, and safe deployment of ML systems in real vehicles. Our AD/ADAS organization develops production‑grade autonomy and active safety technologies that operate in complex, uncertain real‑world environments and ship at global scale.

You’ll collaborate daily with ML researchers, software engineers, robotics engineers, and hardware teams to design, build, and deploy perception and world‑understanding systems that directly influence how vehicles see, reason about, and interact with the world.
 
WHO ARE WE LOOKING FOR?
We are seeking a Lead Engineer to report to the Global Head of World Understanding to drive the multi-year roadmap, architecture, metrics, and technical strategy for software components contributing to understanding around the vehicle.  A system thinker with technical depth in machine learning approaches to complex systems. This engineer will accelerate the adoption of data-driven and deep learning methodologies, focusing on ML system design and verification, supervised/unsupervised learning, multi-modality, multi-tasks training,  and temporal/sequential modeling. This role emphasizes faster and more cost-efficient model iteration, data-driven validation strategies, and unlocking new safety/performance capabilities through advanced ML.
 
The role also requires strong communication skills, an aptitude for mentoring tech leads, influencing and collaborating with diverse stakeholders, including TMC, in identifying deep technical challenges, developing solutions, and executing on the delivery of our autonomy mission.
 

RESPONSIBILITIES

  • Driving the technical vision and multi-year strategy for World Understanding (including perception, mapping, fusion, on-board/off-board) software.
  • Leading project execution, defining efficient engineering processes, and mitigating risks.
  • Collaborate with cross-functional teams  such as Data, Behavior (Planner/Controller/HMI), Developer Ecosystem, and  Product Delivery while  influencing technical decisions across the organization to drive innovation, ensure seamless system integration, and improve overall engineering efficiency.
  • Develop state-of-the-art models  to deliver desired driving environments  in various sensor configurations.
  • Increase speed of the component- and system-level model iteration while maintaining cost efficiency
  • Incorporate data-driven approaches to improve system performance and unlock new capabilities for safety.
  • Maintain the functional architecture design and lead review of technical designs
  • Drive organizational metrics towards performance, safety, and quality
  • Maintain external presence of the department through papers, patents, and presentations
  • Assess and mitigate risk to the technical program
  • Act in partnership with other Lead Engineers in AD/ADAS to solve high impact cross-functional issues
  • Mentor and support engineers, fostering growth through code reviews, knowledge sharing, and collaboration with cross-functional teams to align technical solutions with business goals.
  • Design reusable software components as part of an integrated system.
  • Understand and fulfill the software practices that produce maintainable code, including simulation, continuous integration, code review, HIL testing, and in-vehicle testing.
  • Build component and system level validation strategies that are leveraged to resolve complex interactions between components, increase performance, and evaluate design tradeoffs related to data-driven practices

MINIMUM QUALIFICATIONS

  • 10+ years of professional experience with machine learning applications or applied science
  • MS or PHD in Machine Learning, Mechanical, Electrical, Computer, Aerospace Engineering, or similar 
  • Deep expertise in ML algorithms, frameworks, data-driven methods, supervised/unsupervised learning, multi-modality, multi-tasks training,  and temporal/sequential modeling, and deployment of ML models at scale.
  • Strong R&D potential in algorithm design, data-driven approaches to safety, and large-scale, complex systems architecture, and requirements-driven development
  • Experience with utilizing deep learning frameworks to increase speed and ease of development
  • Experience with temporal data and/or sequential modeling
  • Experience with code quality and systems safety processes for production code delivery, with respect to data-driven methodologies and model validation
  • Strong, practical understanding of real-time system development, performance issues, testing modalities, and tradeoffs
  • Ability to write code in C++ and python
  • Ability to lead in globally distributed team
  • You are an excellent communicator, skilled collaborator, and principled colleague

NICE TO HAVES

  • Published research at top-tier conferences (NeurIPs, CVPR and similar)
  • Proven track record of deploying ML models at scale in self-driving or related fields.
  • Experience with computer vision (e.g.multi-view geometry, camera calibration, depth estimation, neural radiance fields, gaussian splatting, simultaneous localization and mapping) 
  • Experience with Planner ML system design (e.g.  including supervised/unsupervised learning, reinforcement learning, diffusion policy)
  • Experience with robot motion planning (e.g., trajectory optimization, sampling-based planning, model predictive control) 
  • Japanese language skills

For positions based in Palo Alto, CA, the base pay ranges from $189,000-$310,500 a year.
 
Your base salary is one part of your total compensation. We offer a base salary, short-term and long-term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.
 
WHAT WE OFFER
We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many options of the best programs to allow you to do your most meaningful work and to help you shape the future of mobility.
・Excellent health, wellness, dental, and vision coverage
・A rewarding 401k program
・Flexible vacation policy
・Family planning and care benefits

Our Commitment
・We are an equal opportunity employer and value diversity.
・Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.

Woven by Toyota Palo Alto, California, USA Office

Palo Alto, California, United States

Similar Jobs

22 Days Ago
In-Office
Palo Alto, CA, USA
Senior level
Senior level
Automotive • Machine Learning
Design, adapt, and deploy multi-modal perception algorithms for heavy autonomous machinery. Build auto-annotation tools, define evaluation protocols, drive active learning, retrain models, and integrate with MLOps for continuous production deployment.
Top Skills: ArrowCameraLidarMlopsObject StorageParquetPythonPyTorchRadarVision-Language Models (Vlms)
23 Days Ago
In-Office
142K-235K Annually
Expert/Leader
142K-235K Annually
Expert/Leader
Aerospace • Robotics • Defense • Manufacturing
Lead the development of GNC and perception systems for planetary rovers, overseeing a team and ensuring systems meet safety and performance standards.
Top Skills: Embedded SystemsGnc SystemsImage ProcessingMulti-Sensor OdometryPerception SystemsSimulation Software
2 Hours Ago
In-Office
San Jose, CA, USA
151K-313K Annually
Expert/Leader
151K-313K Annually
Expert/Leader
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Lead inventory and global supply chain finance strategy, forecasting, and working capital optimization. Partner with supply chain, manufacturing, FP&A and executives to drive inventory forecasting, scenario modeling, process modernization, systems enablement, and AI/automation use cases. Manage a global team, deliver executive-level insights, and support budgeting, long-range planning, and Board/CFO reviews.
Top Skills: AIAnaplanPower BIS/4Sac-PSAPTm1

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account