Top Senior Data Engineer Jobs in San Francisco Bay Area, CA

Build reliable ETL infrastructure, scalable data pipelines, and trusted datasets serving product and business teams. Partner with data scientists and stakeholders to model data, monitor pipelines, define delivery SLAs, automate workflows, and enable self-service analytics and AI-assisted data exploration. The role requires strong SQL, cloud data-platform expertise, object-oriented programming, data modeling, and experience delivering production-scale data solutions.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.

Build and operate production data pipelines, models, and data products supporting finance, accounting, treasury, compliance, and regulatory reporting. Partner cross-functionally to define requirements, model on-chain and internal data, and ensure data reliability through reconciliation, quality checks, monitoring, and alerting. Use SQL, Python, cloud data warehouse, Airflow, dbt, and AI tooling. Mentor engineers, review technical work, document systems, and communicate data concepts to technical and non-technical audiences.

Build and operate production data pipelines, models, identity resolution, canonical data layers, and GTM data products. Integrate internal and external sources, establish data quality and governance, generate intelligence and AI-derived attributes, and deliver trusted data to CRM systems. Partner with Sales Operations, Finance, Data Science, and engineering teams on definitions, planning, segmentation, routing, observability, security, and platform scalability.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and maintains scalable data pipelines and infrastructure, establishes data governance and quality standards, and drives technical decisions across Headway’s data platform. Partners with Product, Engineering, Analytics, Data Science, Infrastructure, Finance, and Insurance Systems to improve architecture, performance, reliability, security, and AI-readiness. Ensures data is complete, traceable, trustworthy, and suitable for powering internal tools and AI-driven insights.

Designs scalable data architectures, ELT/ETL pipelines, data models, quality frameworks, and self-service data platforms. Partners with engineering, product, program, leadership, and data science teams to translate business needs into technical solutions. The role includes end-to-end technical ownership, large-scale batch and streaming data processing, mentoring junior engineers, system optimization, and on-call support for platform stability.

Lead the reverse-engineering and migration of legacy ETL pipelines from SAP BusinessObjects Data Services and JD Edwards into dbt and Databricks architectures. Build automated data validation, maintain SQL Server write-back mechanisms, collaborate with client stakeholders, and lead and mentor a small engineering team. The role requires hands-on expertise in SQL, Python, Spark, orchestration, cloud platforms, and legacy ERP and ETL migrations.

Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.

Leads data architecture and engineering modernization across business domains. Designs and implements complex pipelines, integrations, data models, and orchestration using Snowflake, AWS, and Airflow. Establishes data quality, governance, security, testing, observability, CI/CD, and reliability practices. Provides architectural guidance, evaluates technical solutions, leads cross-team initiatives, mentors engineers, and improves platform performance and cost efficiency.

Build and maintain scalable Snowflake-based ELT/ETL pipelines, production data models, and observability frameworks. Translate business requirements into reliable solutions supporting analytics, BI, and ML. Establish data quality, governance, lineage, security, and compliance practices while optimizing warehouse performance, cost, and data freshness. Collaborate with Analytics, Product, and Engineering teams, contribute to architecture decisions, evaluate Snowflake tooling, and use AI-assisted development tools to accelerate delivery.

Designs, builds, and optimizes scalable data collection, storage, access, and analytics systems. Creates and automates reliable data pipelines, supports data quality and governance, ensures SLA and performance compliance, and monitors pipeline operations. The role requires collaboration with analytics, business, and customer teams, with potential work involving AI/ML pipelines, Databricks, DevOps practices, streaming data, and event-driven architectures.

Build and maintain scalable batch and incremental data pipelines using Python, SQL, and Snowflake. Develop data warehouse models, transformations, automation, quality checks, lineage, alerting, and performance optimizations. Collaborate with analysts, data scientists, and application teams to deliver trusted datasets, while documenting pipelines, schemas, and data contracts.

Build and maintain scalable batch and incremental data pipelines using Python, SQL, and Snowflake. Develop warehouse models, transformations, automation, data quality checks, lineage, alerting, and performance optimizations. Collaborate with analysts, data scientists, and application teams to deliver trusted datasets, while documenting pipelines, schemas, and data contracts.

Designs and maintains a scalable data platform supporting analytics, machine learning, and AI workloads. Builds tooling for reliable data pipelines, semantic layers, data agents, LLM applications, and evaluation systems. Ensures data quality, availability, observability, and reliability while establishing modeling, testing, and platform best practices. Collaborates with Data Science and Product Engineering, leads solutions from design through implementation, and contributes individually in a fast-paced startup environment.

Build and maintain scalable batch and streaming data pipelines, analytics warehouses, transformation layers, and dimensional data models. Perform SQL-based analysis, support dashboards and reporting, monitor data quality and delivery SLAs, troubleshoot incidents, and improve operational reliability. Collaborate with engineers, analysts, data scientists, and business stakeholders while contributing to documentation, governance, observability, and automation.

Build scalable data ingestion, transformation, and loading infrastructure using Spark, SQL, AWS, and Databricks. Develop entity resolution systems, CI/CD pipelines, anomaly detection, and data quality processes. Design scalable processing systems, orchestration workflows, storage patterns, and data warehouse solutions. Collaborate remotely, document technical designs, scope projects, and solve complex data engineering and data science problems.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Own data pipelines into and out of the warehouse, dbt models, data integrity, governance, identity resolution, reverse ETL, and quality monitoring across growth, lifecycle, and brokerage data. Partner with product, marketing, and operations teams to establish data contracts, ensure accurate and timely business metrics, and support regulated financial data requirements.

Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation.

Lead product data engineering initiatives by designing data models, owning critical pipelines, building data quality and lineage monitoring, and supporting experimentation and ML-ready datasets. Translate business needs into automated data solutions, maintain pipeline SLAs through on-call support, and develop AI-assisted tools for issue detection and resolution. Collaborate with Product, Engineering, Data Science, Machine Learning, and Applied AI teams across Block’s products.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Design and build scalable data infrastructure, including lakehouse architecture, ClickHouse deployments, ETL/ELT pipelines, and data models connecting Postgres with analytics systems. Establish data quality, observability, performance, cost, and reliability standards. Collaborate with product and engineering teams, define data contracts and specifications, support real-time analytics, and use AI-assisted coding and LLMs to accelerate pipeline development and transformation.

Lead design and build of ETL pipelines and Gold Layer tables in Databricks; develop semantic layers, data dictionaries, and AI-ready documentation; create dashboards and ad-hoc analyses to surface marketing and sales KPIs; partner with stakeholders to translate requirements into analytics-ready datasets and enable self-serve BI and agentic AI workflows.

Build and maintain dbt data models and pipelines for billing, payments, usage, and revenue data. Ensure data accuracy, reconciliation, integrity, and timely delivery while defining metrics and monitoring systems. Develop dashboards and self-service data products, support finance data operations, and collaborate with Billing Engineering, Finance, Accounting, and Product teams. Influence billing data architecture and engineering roadmaps.