Top Staff Data Engineer Jobs in San Francisco, CA

This role involves defining data reliability strategies, establishing company-wide standards for data quality, and leading cross-functional data engineering initiatives at Circle.

Lead architecture and delivery of scalable data infrastructure: design and optimize ETL/ELT pipelines, enterprise data models, and data quality frameworks. Define platform standards, mentor engineers, drive cross-functional initiatives, and partner with analytics, data science, and engineering stakeholders to ensure reliable, production-grade data assets.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Lead design and scaling of the data platform and analytics pipelines. Build and maintain ETL/ELT workflows, integrations, serverless data services, and reliable data models. Mentor teammates, improve automation, observability, and data governance to support analytics and operational insights.

Lead architecture and standards for CoreWeave's enterprise data ecosystem: design lakehouse/streamhouse architectures, modeling and semantic layers, governance, data quality, lineage, observability, and reusable data products. Drive cross-domain solutions, resolve performance and scalability constraints, evaluate core data technologies, conduct architecture reviews, and mentor senior engineers.

Lead architecture and reliability of the data platform, build and harden ingestion (batch and CDC), own BigQuery+dbt transformations, establish testing/observability/governance, mentor engineers, develop Python tooling and APIs, run POCs for lakehouse/open table formats, and define AI-assisted development practices.

Design and maintain data pipelines, data contracts, and transformation layers for analytics. Model complex sources, enable observability and lineage, collaborate with product teams, and optimize data structures for scalable cybersecurity and industrial datasets.

Design, build, and operate production ML systems that generate trusted signals for ranking, retrieval, recommendations, propensity/churn/LTV, and next-best-action decisioning. Define signal/data contracts, own feature and candidate generation through serving, experimentation, monitoring, and feedback loops, and evaluate long-term business impact, trust, fairness, and compliance. Partner across product, data, modeling, risk, and compliance and apply AI/agents to accelerate engineering and operations.

Lead architecture and evolution of Headway's data platform (warehouse, ingestion, orchestration, CI/CD, monitoring, cloud infra). Serve as technical anchor across analytics, product, and ML teams, drive platform roadmaps, set standards, mentor engineers, and own end-to-end infrastructure decisions for scale and performance.

The Staff Data Engineer will lead the architecture and reliability of Hinge Health's data platform, manage technical complexity across teams, set data standards, and enhance engineering practices.

As a Senior Staff Data Engineer, you'll set the technical vision for data architecture, lead initiatives across teams, mentor engineers, and ensure platform reliability, while integrating data systems with ML pipelines effectively.

Lead performance architecture and optimization strategies for AI inference services, focusing on maximizing throughput and minimizing latency for advanced models. Mentor the team, collaborate on product features, and maintain expertise in GPU architectures and open-source projects.

Lead architecture, systems, and roadmap for Coinbase's Compliance Reporting Data Platform. Design and build production-grade data models, pipelines, quality frameworks, validations, and certification processes. Establish data contracts, monitoring, reconciliation, and audit-ready processes. Partner with engineering and compliance stakeholders, respond to regulatory exams, and mentor engineers while shaping standards and documentation.

Design, build, and operate production ML signal systems—ranking, retrieval, recommendations, propensity, and next-best-action—covering feature/candidate generation, serving, experimentation, monitoring, and feedback. Define signal contracts (freshness, provenance, confidence), evaluate long-term impact (trust, fairness, compliance), and partner across product, data, and risk teams to deliver reusable customer-intelligence capabilities.

Design, build, and operate the core data warehouse, ingestion, orchestration, and cataloging platform. Develop batch and streaming pipelines, ensure data quality, governance, observability, and provide ML data platform capabilities. Lead architecture, improve platform reliability and performance, and collaborate with product, engineering, data science, security, and compliance teams.

Lead design and operation of a cloud-native data platform: set technical direction, build scalable ingestion/processing/warehousing pipelines (batch & streaming), support ML data needs, mentor engineers, drive projects end-to-end, run planning/standups/on-call, and eventually lead a data engineering team.

Lead architecture and implementation of fleet telemetry, time-series storage, streaming pipelines, and CRM/warehouse integrations on AWS. Build tools for proactive fleet health, partner cross-functionally (firmware, manufacturing, ops), support on-call as systems mature, and design LLM-driven automations to increase team leverage.

Technical leader for Data Engineering responsible for designing, operating, and optimizing Snowflake-based data platforms, self-hosted orchestration (Prefect), dbt practices, AWS infrastructure, and data pipelines. Drive architecture, mentor engineers, partner cross-functionally, ensure observability and production-grade practices, and enable model-ready datasets and AI/LLM workflows.

Design, build, and scale reliable batch and real-time data pipelines and warehouses. Partner with engineering, data science, and business teams to define data models, improve observability, optimize storage and querying, and evangelize data engineering best practices across the company.

Own and evolve the data platform by leading architectural evolution, collaborating with teams for strategic data initiatives, and ensuring reliable data systems.

Lead design and evolution of SentiLink's data platform for fraud detection. Architect scalable batch and streaming pipelines, improve reliability, performance, and observability, set engineering standards, mentor engineers, drive cross-team technical initiatives, participate in production support/on-call, and evaluate build-vs-buy and emerging technologies.

As a Staff Data Engineer, you'll architect a scalable data platform, optimize data pipelines, establish data standards, and mentor teams to drive technical excellence.

Lead the technical strategy for Coinbase's Data Platform, architecting data systems for AI/ML workloads and ensuring data reliability, performance, and cross-functional alignment.

Design, build, and maintain scalable analytics pipelines and data models; ensure data quality, reliability, and security; enable self-service data access; implement monitoring and logging; collaborate with analysts, data scientists, and stakeholders; evaluate and manage data tools and vendors; apply AI tools to improve development and data reliability.

Lead the vision and execution for scalable data governance and quality across Airbnb. Architect future-proof data ecosystems, define best practices and tooling, drive cross-functional policy implementation (privacy, legal, infosec), mentor senior engineers, and influence executive strategy to embed stewardship into the data product lifecycle.