As a Senior Data Engineer at TRI, you will design and build robust data infrastructure and pipelines to support autonomy research and simulation workflows.
At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience. To lead this transformative shift in mobility, we’ve built a world-class team in Automated Driving, Energy & Materials, Human-Centered AI, Human Interactive Driving, Large Behavioral Models, and Robotics.
The Automated Driving Advanced Development division at TRI will focus on enabling innovation and transformation at Toyota by building a bridge between TRI research and Toyota products, services, and needs. We achieve this through partnership, collaboration, and shared commitment. This new division is leading a new cross-organizational project between TRI and Woven by Toyota to conduct research and develop a fully end-to-end learned driving stack. This cross-org collaborative project is harmonious with TRI’s robotics divisions' efforts in Diffusion Policy and Large Behavior Models.
We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development workflows. This includes large-scale ingestion pipelines, structured feature stores, labeling infrastructure, scene search and data discovery tools, and performance diagnostics for machine learning and simulation workflows.
Responsibilities
- Design and implement scalable, production-grade pipelines for data ingestion, transformation, storage, and retrieval from vehicle fleets and simulation environments.
- Build internal tools and services for data labeling, curation, indexing, and cataloging across large and diverse datasets.
- Collaborate with ML researchers, autonomy engineers, and data scientists to design schemas and APIs that power model training, evaluation, and debugging.
- Develop and maintain feature stores, metadata systems, and versioning infrastructure for structured and unstructured data.
- Support the generation and integration of synthetic datasets with real-world logs to enable hybrid training and simulation workflows.
- Optimize pipelines for cost, latency, and traceability, ensuring reproducibility and consistency across environments.
- Partner with simulation and cloud platform teams to automate workflows for closed-loop testing, scenario mining, and performance analytics.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
- 8+ years of experience building data-intensive software systems, ideally in robotics, autonomous driving, or large-scale ML environments.
- Proficient in Python, SQL, and familiar with C++.
- Experience designing ETL pipelines using modern frameworks (e.g., Apache Spark, Flyte, Union).
- Strong knowledge of cloud-native architectures, including AWS services (e.g., S3, or equivalents (Google Cloud platform)
- Familiarity with sensor data types (camera, lidar, radar, GPS/IMU) and common data serialization formats (e.g., protobuf. ROS2bag, MCAP).
- Deep understanding of data quality, observability, and lineage in high-volume systems.
- Track record of building reliable and performant infrastructure that supports both ad-hoc exploration and repeatable production workflows.
Bonus Qualifications
- Experience in AD/ADAS, robotics, or autonomous systems — especially handling perception or planning datasets.
- Familiarity with ML pipeline orchestration frameworks (e.g. Kubeflow, SageMaker, etc).
- Experience working with temporal or spatial data, including geospatial indexing and time-series alignment.
- Exposure to synthetic data generation, simulation logging, or scenario replay pipelines.
- Strong software engineering fundamentals, CI/CD, testing, code review, and service deployment best practices.
- Experience collaborating with cross-functional, distributed teams across research and production orgs.
Please include links to any relevant open-source contributions or technical project write-ups with your application.
The pay range for this position at commencement of employment is expected to be between $180,000 and $270,000/year for California-based roles. Base pay offered will depend on multiple individualized factors, including, but not limited to, business or organizational needs, market location, job-related knowledge, skills, and experience. TRI offers a generous benefits package including medical, dental, and vision insurance, and paid time off benefits (including holiday pay and sick time). Additional details regarding these benefit plans will be provided if an employee receives an offer of employment.
Please reference this Candidate Privacy Notice to inform you of the categories of personal information that we collect from individuals who inquire about and/or apply to work for Toyota Research Institute, Inc. or its subsidiaries, including Toyota A.I. Ventures GP, L.P., and the purposes for which we use such personal information.
TRI is fueled by a diverse and inclusive community of people with unique backgrounds, education and life experiences. We are dedicated to fostering an innovative and collaborative environment by living the values that are an essential part of our culture. We believe diversity makes us stronger and are proud to provide Equal Employment Opportunity for all, without regard to an applicant’s race, color, creed, gender, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, medical condition, religion, marital status, genetic information, veteran status, or any other status protected under federal, state or local laws.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records for employment.
Top Skills
Spark
AWS
C++
Flyte
GCP
Python
SQL
Toyota Research Institute Los Altos, California, USA Office
4440 El Camino Real, Los Altos, CA, United States, 94022
Similar Jobs
Fintech • Mobile • Software • Financial Services
The role involves designing and maintaining data pipelines and architectures for the People Analytics team, enhancing data systems for better decision-making and compliance.
Top Skills:
ContainersGCPOrchestration ToolsPythonRedshiftSnowflakeSQL
Artificial Intelligence • Big Data • Healthtech • Biotech • Pharmaceutical
Transform Electronic Health Records (EHR) data into structured assets, build scalable data pipelines, and apply Generative AI techniques for analytics within a healthcare-focused team.
Top Skills:
DagsterDbtPythonSnowflakeSQL
Fintech • HR Tech
The Senior Data Engineer will build scalable data systems, optimize data workflows, and collaborate with teams to enhance data-driven decisions.
Top Skills:
BigQueryDatabricksDbtPythonRedshiftSnowflakeSQL
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
