Designs and governs scenario and test sets for autonomous-vehicle behavior verification. Owns validity checks and release-pipeline approvals, translates behavior requirements into testable criteria, investigates behavior deficiencies and test escapes, distinguishes real failures from simulation artifacts, and coordinates verification cadence across planning, simulation, evaluation, safety, operations, and platform teams.
Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.
With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: www.waabi.ai
At the heart of our mission is an unwavering commitment to safety. Behavior Verification answers one question: is the driver's on-road behavior good enough to release, and how can we prove it even further? We are seeking a rigorous and decisive systems engineer to build the evidence behind that answer. You will define the scenario and test set content that various Software releases are measured against and that enable the development of new capabilities and features, establish the validity checks that keep those test sets trustworthy, and act as the gatekeeper for what enters the release pipeline. Your work directly informs whether autonomy software is promoted.
You will…
- Design and document the scenario and test sets that establish on-road behavior performance, from minimum to comprehensive.
- Own what enters the release pipeline: define and run the scenario validity checks, and approve or refuse test sets before they are used to judge a release.
- Maintain continuous quality feedback of the artifacts test sets depend on — scenarios, taggers, graders and the taxonomy behind them.
- Turn behavior requirements into testable criteria, working with Behavior Requirements on targets and acceptance criteria that someone will sign.
- Investigate behavior deficiencies: find further instances, establish what exposure we have to them, and return them to the pipeline as test escapes.
- Distinguish genuine behavior failures from simulation artifacts, and raise simulation fidelity gaps with the corresponding teams.
Work across the organization — motion planning, simulation, evaluation, operations, safety methodology and platform — and hold the interfaces between them. - Align verification phases and cadence with the organization: what runs on a daily release, and what a significant step in exposure requires.
Qualifications:
- Bachelor’s degree or Master’s degree in a relevant engineering or related field (e.g., Software Engineering, Electrical Engineering, Computer Science, Robotics, Advanced Controls, Aerospace, etc.).
- Experience verifying safety-critical systems, ideallyin autonomous vehicles.
- Demonstrated experience designing test cases from requirements, and assessing what a test set covers and what it misses.
- Applied statistics: sample size, confidence, and what a result does and does not support.
- Proficiency in Python and the ability to navigate a large codebase.
- Familiarity with autonomous vehicle requirements, behaviors and design methodologies.
- Strong ability to structure, document and prioritize a large number of test sets and test strategies.
- Ability to work cross-functionally in a diplomatic way, across teams that do not always agree.
- A drive for commitment and accountability, for yourself and for others.
Bonus/nice to have:
- Trucking or heavy-vehicle exposure.
- Machine learning experience, particularly model evaluation and false-positive / false-negative trade-offs.
- Exposure to regulatory frameworks: NHTSA, ISO 26262, SOTIF.
- Familiarity with the tooling required to extract coverage and exposure from large driving-log sets.
- Comfortable working in a newly formed team, where the process has to be built rather than followed.
The US yearly salary range for this role is: $149,000 - $190,000 USD and the Canada salary range for this role is: $160,000 - $204,000 CAD in addition to competitive perks & benefits. Waabi US Inc. and Waabi Canada Inc.'s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. The salary base range is reflective of the minimum and maximum target for new hire salaries for the position across all US and Canada locations. Note: The Company provides additional compensation for employees in this role, including discretionary equity incentive awards and discretionary annual performance bonus.
Perks/Benefits:
- Competitive compensation and equity awards.
- Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).
- Unlimited Vacation.
- Flexible hours and Work from Home support.
- Daily drinks, snacks and catered meals (when in office).
- Regularly scheduled team building activities and social events both on-site, off-site & virtually.
- As we grow, this list continues to evolve!
Waabi is a technology start-up building technologies to transform the way the world moves. Join our talented team to be a part of the future and to make an impact!
Waabi is an equal opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all our employees. We seek applicants of all backgrounds and identities, across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law. We make workplace accommodations for qualified individuals with disabilities as required by applicable law. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know.
Waabi San Francisco, California, USA Office
San Francisco, California, United States
Similar Jobs
.jpg){kind=logo}
Healthtech • Social Impact • Software • Telehealth
Create brand and campaign designs supporting B2B marketing, digital experiences, print, events, sales enablement, and partner marketing. Translate audience insights and messaging into compelling creative, independently own campaigns from brief through delivery, collaborate with writers and marketers, present design rationale, and maintain brand consistency. Preferred work includes healthcare experience, motion design, AI-assisted workflows, and modular design systems.
Top Skills:
Adobe Creative CloudFigma
Enterprise Web • Fintech • Marketing Tech • Software
Leads mobile QA and automation strategy for iOS and Android React Native applications. Architects scalable test frameworks for mobile, web, and REST APIs; develops automated UI, integration, regression, performance, and release tests; integrates testing into CI/CD pipelines; manages QA backlogs and release readiness; troubleshoots defects; defines quality standards; and mentors QA engineers while supporting hiring and practice development.
Top Skills:
AndroidAppiumBrowserstackCi/CdDetoxiOSMaestroPlaywrightPostmanPythonReact NativeRest ApisSmartbear
Cloud • Information Technology • Security • Software • Cybersecurity
Owns end-to-end enterprise DSPM delivery, including multi-cloud architecture, data connector deployment, classification pipelines, security policies, identity controls, Zero Trust integrations, troubleshooting, and customer consulting. Partners with engineering, product, sales, and enterprise customers to reduce cloud data risks, support AI governance, and optimize Zscaler security solutions across complex environments.
Top Skills:
AWSAzureBigQueryCloud IamDatabricksGCPNoSQLOauth2PythonRbacRest ApisSAMLSaseScimSharepointSmbSnowflakeSQLSseSsoZero TrustZscaler ZdxZscaler ZiaZscaler Zpa
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
