Top Data Engineer Jobs in San Francisco Bay Area, CA

Lead Notion’s Data Foundations team by setting multi-quarter platform strategy, developing engineers and technical leaders, and guiding complex initiatives across data lakes, streaming, distributed compute, governance, and reliability. Drive enterprise-ready capabilities including data residency, access controls, lifecycle management, and key management. Improve Kafka, Debezium, S3/Iceberg, Spark, EMR, and Athena scalability, reliability, usability, and cost efficiency while partnering across engineering, AI, search, infrastructure, and security teams.

Build and maintain scalable data pipelines, infrastructure, data models, and APIs using Python, SQL, Airflow, Snowflake, dbt, Terraform, and cloud services. Ensure data quality, security, observability, and reliability while collaborating with analysts, product managers, and engineering teams. Own aspects of the FastAPI data service, including design, deployment, monitoring, and performance. Handle sensitive healthcare data in compliance with governance standards.

Lead pre-sales technical engagements to design and optimize scalable cloud lakehouse data platforms (Snowflake/Databricks). Provide architecture reviews, ETL/ELT pipeline design, governance and AI-ready data foundations, support services sales, and translate technical tradeoffs into actionable recommendations for engineering and executive stakeholders.

Lead pre-sales data engineering engagements to design and implement scalable lakehouse data platforms (Snowflake/Databricks). Advise customers on data strategy, governance, pipelines, AI-ready foundations, migrations, and translate technical solutions into business outcomes while supporting sales and partner enablement.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Build and operate production-grade ELT pipelines from Benchling, Salesforce, and third-party systems into Snowflake using dbt. Own ingestion, transformation, warehouse, BI, governance, monitoring, testing, access controls, privacy, cost, and performance. Partner with AI engineering to provide trusted data for internal AI applications and agentic workflows, contribute to warehouse and metrics-layer architecture, and translate cross-functional stakeholder needs into scalable data solutions.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

Build and own marketing data, attribution, tracking, audience sync, and conversion infrastructure. Integrate product, CRM, warehouse, and advertising platforms; send offline conversions and LTV signals to ad platforms; maintain event schemas and dashboards; debug data discrepancies; implement privacy-safe tracking; and partner cross-functionally with growth, product, marketing, and data teams.

Own and scale Collective’s data platform by building reliable batch and event-driven pipelines into BigQuery, modeling data with dbt, and enforcing quality, observability, security, and cost standards. Partner with engineers, analysts, and business stakeholders to deliver trustworthy datasets, metrics, reporting, and AI-enabled warehouse access. The role includes production ownership, incident response, governance, infrastructure practices, and support for analytics and LLM-based tools.

Build and operate reliable data systems and products supporting clinical operations, drug evaluation, business development, analytics, machine learning, and AI agents. Responsibilities include designing pipelines, canonical data models, data contracts, warehouse transformations, quality and observability practices, governance for regulated data, and incident response. The role partners closely with Product Engineering and Data Science, uses AI-assisted development, contributes to architecture, and mentors other engineers.

Build, test, document, and optimize data pipelines and foundational datasets for Figma’s data warehouse. Interns will support data quality, scalability, analytics, experimentation, and cross-functional data needs while owning a scoped project from definition through implementation, testing, documentation, and results sharing.

Lead architecture, development, and optimization of a cloud-native data platform. Design high-volume batch and streaming pipelines, optimize data processing across AWS, Snowflake, Redshift, and Athena, and implement Iceberg-based data management. Establish security, privacy, observability, and DataOps practices while mentoring engineers, guiding technical direction, collaborating with data science teams, and delivering scalable petabyte-level data infrastructure.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

Own Modal’s go-to-market data platform, including organization and people graphs, identity resolution, CRM schemas, Snowflake and dbt models, reverse ETL pipelines, revenue operations metrics, forecasting, attribution, and data quality systems. Partner with Data, RevOps, and Marketing to support customer context, routing, territory management, campaigns, reporting, and reliable GTM workflows.

Architects, builds, tests, and maintains scalable data infrastructure and ELT/ETL pipelines using AWS Glue, Glue Catalog, and Step Functions. Performs data modeling, SQL querying, data migration, schema optimization, validation, and data quality improvements. Partners with analytics and business teams to transform raw data into production-ready datasets. The role may also support AI/ML pipelines, governance, access controls, DevOps workflows, and real-time data architectures.

Build and maintain data pipelines for network and operational telemetry, integrate DataMiner and other monitoring systems, create Power BI dashboards, configure monitoring metrics and alerts, automate reporting, analyze network performance and recovery events, and translate technical findings into actionable insights for technical and executive stakeholders.

Build and operate data pipelines that integrate customer financial data from ERPs, warehouses, and payment systems. Develop AI agents that automate ERP implementations, partner with implementation teams to understand and transform customer data, and contribute to shared AI platform capabilities. The role requires strong full-stack engineering fundamentals, autonomous execution, and comfort working in an ambiguous, fast-moving environment.

Build and scale batch and streaming data pipelines using Databricks, Spark, Kafka, AWS, Python, SQL, dbt, and Fivetran. Develop ETL/ELT and reverse ETL workflows, curated datasets, dashboards, data quality controls, and data activation integrations with Salesforce, HubSpot, and Braze. Partner with Finance, Marketing, Product, and Engineering on reporting, forecasting, segmentation, and AI/ML applications, including RAG, embeddings, and agent-based systems.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Design and build maintainable data pipelines, ETL processes, and data architecture standards. Collaborate with product managers, analysts, and machine learning engineers to translate requirements into automated, scalable solutions. Apply software engineering best practices, asynchronous systems, APIs, streaming, testing, monitoring, and Python and SQL expertise. Help prioritize data initiatives based on business impact and communicate complex technical concepts to technical and non-technical stakeholders.

Designs, builds, and operates scalable batch and streaming data pipelines on Databricks for federal missions. Responsibilities include developing Spark and Delta Lake solutions, managing clusters and workflows, implementing Unity Catalog governance and security, optimizing ETL/ELT processes, integrating CI/CD, supporting machine learning and advanced analytics, monitoring data quality, and collaborating with technical teams and stakeholders.

Design, build, and scale reliable data infrastructure, including event ingestion, stream processing, data warehouses, ETL pipelines, analytics tools, and machine learning systems. Optimize performance, reliability, security, and data quality across AWS regions and data centers. Collaborate with analytics and data science teams, troubleshoot complex systems, influence architecture, conduct code reviews, and mentor data engineers while helping establish engineering best practices.

Design and build scalable financial data pipelines, data-serving platforms, and AI-enabling frameworks. Ensure data integrity and quality across sources, optimize query performance, troubleshoot data issues, and promote AI-assisted software development. The role requires expertise in Python or Java, databases, warehouses, ETL, batch processing, cloud infrastructure, and Kubernetes, with preferred experience in Snowflake, Airflow, and dbt.