Top Data Engineer Jobs in San Francisco Bay Area, CA

Build and own the core data models and pipelines connecting product usage, accounts, revenue, billing, and customer health. Create trusted metrics, dashboards, and self-serve reporting. Partner with Product, Engineering, and GTM teams to improve data quality, design AI-enabled workflows and agents, and support leadership with accurate visibility into adoption, pipeline, retention, expansion, and revenue.

Lead end-to-end data integrations with utility customers: scope requirements, map and transform datasets, run and monitor pipelines, triage issues, and productize repeatable tooling to speed implementations.

Lead customer integrations by building warehouse-native or managed ClickHouse pipelines, construct semantic metadata layers, canonicalize source data into unified growth models, and act as the technical lead for enterprise deployments while partnering with AI discovery agents to accelerate onboarding and mapping.

Build and maintain centralized pricing data infrastructure, scalable workflows, and data pipelines; integrate AI capabilities; deliver pricing tools, reporting, and governance to support data-driven pricing and budgeting across the firm.

Build and scale core data infrastructure and foundational datasets. Design, develop, and maintain scalable data pipelines for analytics, ML, experimentation, and product use cases. Implement data quality, audits, alerting, and anomaly detection. Partner with product, engineering, and business stakeholders and help establish long-term, scalable data architecture and tooling.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

Build and maintain governed Silver/Gold data models and semantic assets on Databricks. Translate stakeholder KPIs into testable, reusable transformations, apply enterprise modeling standards, enable domain self-service, ensure data sensitivity and governance, and review domain-contributed models for production readiness.

Own and evolve the data lake and analytics stack powering fleet observability. Build and maintain scalable ETL/ELT pipelines, operate data lake infrastructure (Iceberg, Trino, Airflow, Spark, Superset), produce analytics and executive reporting, create dashboards and runbooks, and implement data governance and observability.

Design and implement end-to-end data integration and warehousing solutions for large volumes. Implement Hadoop/Hive data movement, script in Linux shell and Python, develop SQL for integration and analysis, and perform high-volume DW performance tuning. Vertica experience is a plus. Requires technical independence and a BS in CS/EE.

Build and own customer data ingestion and large-scale pipelines powering AI workers. Design syncing, retrieval, and data lake systems, improve reliability/observability, partner with product/backend teams, and contribute across infrastructure to give AI agents access to enriched customer data.

As an Analytics Engineer, you'll manage the data stack, design database architecture, build data pipelines, and oversee reporting and data quality.

Design, build, and maintain scalable data ingestion and ETL pipelines across a growing data lake. Define and enforce data quality standards, SLOs, and validation frameworks. Optimize pipelines for performance and cost, expand monitoring and alerting, and enable stakeholders to self-serve on data infrastructure.

Build and maintain data infrastructure to measure agent behavior and user interactions, design evaluation frameworks for AI agents, analyze user behavior to inform product strategy, and partner with engineering and leadership to solve high-impact business problems using data.

Build and maintain scalable data pipelines, trusted datasets, and reporting systems to support infrastructure deployment, hardware operations, capacity planning, and supply chain analytics. Partner with stakeholders, improve data quality, lineage, and observability, and enable executive reporting, forecasting, and operational reviews. Integrate new telemetry sources and document systems for long-term maintainability.

Lead architecture and evolution of Headway's data platform (warehouse, ingestion, orchestration, CI/CD, monitoring, cloud infra). Serve as technical anchor across analytics, product, and ML teams, drive platform roadmaps, set standards, mentor engineers, and own end-to-end infrastructure decisions for scale and performance.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Design and maintain pipelines and tooling to ingest, validate, model, and serve multi-modal driving data for ML training, evaluation, and debugging. Collaborate with ML, vehicle software, curation, and fleet teams to scale the data stack and make datasets discoverable and queryable.

Design, build, and maintain data pipelines, ETL processes, and data warehousing solutions using Python and GCP/BigQuery. Ensure data quality, optimize storage and processing, support new data products, and mentor junior engineers while collaborating with the CTO and team.

Design, develop, and maintain scalable data pipelines, ETL processes, and BigQuery/GCP-based data storage. Ensure data quality, implement monitoring, assist product launches, mentor junior engineers, and collaborate closely with the CTO and team.

Join a talent network connecting data engineers with VC-backed startups. Build scalable batch and real-time pipelines, data models, warehouses/lakehouses, ensure data quality, support ML pipelines, integrate diverse data sources, and define data architecture and governance.

Lead architecture and delivery of scalable data infrastructure: design and optimize ETL/ELT pipelines, enterprise data models, and data quality frameworks. Define platform standards, mentor engineers, drive cross-functional initiatives, and partner with analytics, data science, and engineering stakeholders to ensure reliable, production-grade data assets.

Design, build, and optimize Snowflake-based data warehouses and dbt transformation pipelines. Develop scalable ETL/ELT ingestion, tune SQL and warehouse performance, implement data quality/testing (dbt tests), and maintain CI/CD and version-controlled data workflows while collaborating with analysts, data scientists, and stakeholders.

Lead design, build, and operate real-time, Flink-based streaming data platforms. Develop low-latency, stateful pipelines, enforce event schemas/contracts, ensure fault tolerance and observability, mentor engineers, and partner with architecture and compliance teams to deliver resilient streaming solutions for banking use cases.