Leads architecture, optimization, scaling, and ownership of Zoox’s enterprise and AI data platform. Builds self-healing pipelines, governance frameworks, data quality and observability systems, secure access controls, lifecycle policies, and automated CI/CD deployment infrastructure. Optimizes Databricks and AWS EMR performance and costs while enabling low-latency, AI-ready data foundations. The role also drives enterprise security, compliance, schema evolution, and developer velocity, with opportunities to apply GenAI, Terraform, and EKS.
Zoox is seeking a high-agency, hands-on Lead Data Platform Engineer to architect, optimize, scale and own the next generation of our enterprise & AI data foundation. In this role, you will architect a high throughput, data fabric that unifies data across Zoox and downstream AI agents. You will drive performance tuning, cost optimization, RBAC, data governance and CI/CD pipelines to deliver secure, low-latency, 'AI-ready' data foundations across the organization.
You will serve as the primary technical driver for our data platform, designing autonomous frameworks, building scalable data infrastructure and establishing strict standards for security and developer velocity. This is an engineering-intensive leadership role for a builder who thrives on solving complex challenges.
In This Role, You Will...
- Scaling self-healing data pipelines that automatically handle schema evolution, detect anomalies, execute circuit breakers and recover from failures without manual intervention.
- Define and enforce company-wide data governance, access, automated data quality testing, schema evolution policies and metadata management to maintain high-fidelity data assets.
- Implement intelligent storage lifecycle strategies, resource throttling and query optimization to minimize compute overhead while delivering high-throughput, low-latency data access for analytics and AI agents. With a focus on Databricks vs EMR (AWS) cloud optimization (cost and performance).
- Build automated CI/CD deployment templates, environment isolation, testing frameworks and version control standards, enabling rapid, reliable and zero-downtime deployments
Qualifications
- 10+ years of hands-on experience in Data Platform Engineering or Software Engineering with a proven track record of architecting and scaling production-grade data foundations.
- Deep expertise in scaling and optimization, query tuning, compute resource allocation and implementing efficient compute-storage lifecycle policies to minimize infrastructure costs.
- Experience implementing enterprise security standards, Role-Based Access Control (RBAC), Active Directory/IAM roles and fine-grained data masking, with strong familiarity supporting enterprise compliance requirements (e.g., SOX, audit trail controls, data retention policies).
- Track record of establishing enterprise data governance frameworks, automated schema evolution controls, data quality audits and near real-time observability/alerting.
- Hands-on experience building automated CI/CD pipelines, environment isolation (branch testing, rollback mechanisms), version control and automated deployment testing for data assets.
Bonus Qualifications
- Experience incorporating LLMs or GenAI directly into pipeline operations (e.g., code generation, triage and root-cause analysis, automated data reconciliation, backfills or anomaly detection).
- Experience with infrastructure-as-code (Terraform) and containerization/orchestration (EKS) for elastic compute management. GPU/CPU performance optimization & utilization.
- Previous experience in the autonomous vehicle, robotics or high-tech manufacturing sectors.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to [email protected] or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
Zoox Foster City, California, USA Office
4000 E 3rd Ave, Foster City, CA, United States, 94404
Zoox Foster City, California, USA Office
1149 Chess Drive, Foster City, CA, United States, 94404
Zoox Fremont, California, USA Office
47540 Kato Road, Fremont, CA, United States, 94538
Zoox San Francisco, California, USA Office
60 Broadway St, San Francisco, CA, United States, 94111
Similar Jobs
An Hour Ago
Financial Services
Provide comprehensive financial planning and advice to individuals and families, build and manage a book of business, acquire and deepen client relationships, deliver personalized investment solutions, educate clients on digital channels, and collaborate with Chase partners to meet clients’ broader financial needs.
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Manage and grow a portfolio of automotive dealerships across the East Bay, driving subscription revenue, retention, referrals, and account expansion. Build relationships with dealership decision-makers, provide consultative recommendations using market and performance data, manage sales pipelines and forecasts, and identify cross-sell and upsell opportunities. Support client onboarding, implementation, issue resolution, and collaboration across business units while meeting territory revenue goals.
Top Skills:
Analytics ToolsCrm SystemsDigital AdvertisingOnline PlatformsSales Enablement ToolsSocial Media
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Leads strategic process-improvement initiatives across digital marketplace operations. Maps current and future-state processes, conducts data analysis, develops business cases, manages improvement roadmaps, and oversees cross-functional project delivery. Partners with finance, analytics, and business stakeholders to influence priorities, implement changes, measure outcomes, and improve adoption. Requires strong communication, process design, executive presentation, and change-management skills.
Top Skills:
AIGenesysLucidchartPower BISalesforceTableauVisio
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
