Top Senior Data Engineer Jobs in San Francisco Bay Area, CA

Design, build, and maintain data pipelines and architectures, apply advanced analytics to generate client insights, develop BI dashboards, collaborate with stakeholders to solve data challenges, and support managed-services engagements while upholding technical and professional standards.

Senior Data Engineer on PwC's Managed Data, Analytics & Insights team to design, build and manage advanced data ecosystems. Responsibilities include designing data solutions and scalable pipelines, solving complex problems, mentoring junior staff, maintaining high delivery standards, and building client relationships while aligning solutions to business context.

The Data Engineer will architect ETL pipelines, manage a central data lake, and ensure data quality and best practices in collaboration with various teams.

As a Data Engineer, you will design, implement, and maintain data systems for Notifications at Whatnot, ensuring data quality and performance while collaborating with cross-functional teams on data architecture and workflows.

Design and operate scalable data systems for People Analytics, ensuring reliability and privacy of sensitive employee data. Collaborate with leadership to create data products for decision-making.

Design and build data infrastructure, pipelines, and integration solutions using cloud and big-data tools. Develop data lakes/warehouses, ensure data quality and security, apply data modeling and DAGs, use Databricks, Airflow, and Hadoop, and collaborate with clients to deliver actionable insights.

The Data Engineer will architect and develop robust data frameworks for data platforms, focusing on data transformations and automated workflows. Responsibilities include collaborating with stakeholders, ensuring data quality, and maintaining high engineering standards.

As a Senior Associate in Data Engineering at PwC, you will design and implement data architecture strategies, analyze complex issues, mentor junior members, and build client relationships while ensuring adherence to project standards.

As a Senior Manager in Data Engineering, you will lead teams to design data architectures, develop data solutions, manage client engagements, and ensure compliance with data governance policies.

Lead data engineering projects, develop and implement data pipelines and architecture strategies, manage data quality, and mentor team members at PwC.

Lead data engineering efforts within Technology Consulting: design data architecture and pipelines, implement AWS/Redshift and ETL solutions, support BI (QlikView/Oracle BI), coach teams, manage client relationships and SLAs, apply systems thinking to optimize outcomes and validate solutions with stakeholders.

The role involves building scalable data pipelines, optimizing ETL workflows, designing data schemas, and ensuring data quality and governance while collaborating with cross-functional teams.

Design and implement scalable data models and ETL pipelines (batch and streaming), ensure data quality/SSOT, collaborate with product and platform teams to resolve issues, contribute to data governance, and explore practical integrations between data engineering and AI.

Design and implement end-to-end data integration and warehousing solutions for large volumes. Implement Hadoop/Hive data movement, script in Linux shell and Python, develop SQL for integration and analysis, and perform high-volume DW performance tuning. Vertica experience is a plus. Requires technical independence and a BS in CS/EE.

Maintain data integrity and quality through advanced testing and validation of ETL pipelines. Analyze complex data issues, build solutions, mentor junior staff, engage with clients, and support continuous improvement across data management, governance, and pipeline orchestration.

Design, build, and maintain scalable data ingestion and ETL pipelines across a growing data lake. Define and enforce data quality standards, SLOs, and validation frameworks. Optimize pipelines for performance and cost, expand monitoring and alerting, and enable stakeholders to self-serve on data infrastructure.

Design, implement, and maintain scalable data infrastructure and real-time processing for analytics platforms. Migrate systems from AWS to on-prem Kafka/Spark, implement data transformations, support production, optimize pipelines, query and analyze data, and build scripts and APIs to operationalize data science work.

Build and maintain scalable data pipelines, trusted datasets, and reporting systems to support infrastructure deployment, hardware operations, capacity planning, and supply chain analytics. Partner with stakeholders, improve data quality, lineage, and observability, and enable executive reporting, forecasting, and operational reviews. Integrate new telemetry sources and document systems for long-term maintainability.

The Principal Data Engineer will lead complex data projects, design robust data pipelines, and drive architectural strategy for a scalable data ecosystem, while mentoring other engineers and ensuring the quality and usability of data solutions.

As a Data Analytics Engineer, you'll build and manage data models in Snowflake, structure datasets for optimal AI performance, and own data transformation while ensuring quality and accessibility for all teams.

As a Data Engineer at Promise, you'll design data architectures, automate workflows, enforce data quality, and support analytics, enabling data-driven decisions.

The Staff ML Data Engineer will design and build data systems for AI products, focusing on multimodal data and ensuring efficient data workflows for machine learning research and production.

Design, build, and maintain scalable data pipelines and platform infrastructure. Define data governance, monitoring, and quality standards. Partner cross-functionally with Product, Engineering, Analytics, and Data Science. Drive technical decisions, performance optimization, and infrastructure-as-code for a growing data platform supporting patients, providers, and business teams.

Lead design, build, and optimization of large-scale real-time and batch data ingestion and transformation pipelines. Integrate enterprise systems (SFDC, NetSuite, Workday), ensure data quality, observability, and reliability, and enable analytics/AI workflows. Architect solutions using Airflow, dbt, Python, Kafka, Snowflake, apply DevOps/CI-CD practices, mentor global teams, manage multiple projects, and align data engineering initiatives with product and business stakeholders.

Own and scale the data platform powering ReadyOn's real-time labor OS. Design and operate batch and real-time pipelines, transformations, and data services (Python, PySpark, Airflow, Glue, Snowflake, Postgres). Build connectors, observability, data quality, and feature-store infrastructure while partnering with AI, backend, and product teams and providing technical leadership and mentorship.