Get the job you really want.

Top Lead Data Engineer Jobs in San Francisco, CA

13 Days AgoSaved
Easy Apply
Hybrid
San Francisco Bay Area, CA
Easy Apply
180K-250K Annually
Senior level
180K-250K Annually
Senior level
Legal Tech • Software • Generative AI
The Lead Data Engineer will design and build the data warehouse, develop ETL/ELT pipelines, and establish data governance and quality practices while building a team to support data-driven growth.
Top Skills: Ai-Assisted Development ToolsAirflowBigQueryData WarehouseDbtPrefectRedshiftSnowflakeSQL
3 Days AgoSaved
In-Office
San Francisco Bay Area, CA
111K-226K Annually
Mid level
111K-226K Annually
Mid level
Consulting
The Lead Data Engineer will design, develop, and maintain ETL pipelines, ensuring effective data extraction, transformation, and loading from various sources, while collaborating with stakeholders and solving complex business issues.
Top Skills: AWSAzureETLJavaPythonSnowflake
3 Days AgoSaved
In-Office
San Francisco Bay Area, CA
111K-226K Annually
Mid level
111K-226K Annually
Mid level
Consulting
Seeking an ETL Engineer to design and maintain ETL pipelines, troubleshoot issues, and contribute to the data engineering team, working with various data sources and ensuring compliance with financial regulations.
Top Skills: AWSAzureBi ToolsETLFlat FilesJavaPythonRelational DatabasesSnowflakeWeb Apis
Reposted 6 Days AgoSaved
Hybrid
San Francisco Bay Area, CA
150-200 Annually
Mid level
150-200 Annually
Mid level
Information Technology
The Lead Data Engineer/Architect designs and implements GCP solutions, focusing on data pipelines, architecture, and leadership in a client-facing role.
Top Skills: Apache BeamBigQueryCi/CdCloud ComposerCloud FunctionsCloud StorageDataflowGoogle Cloud PlatformPub/SubPythonSQLTerraform
Reposted 11 Hours AgoSaved
Remote
San Francisco Bay Area, CA
100K-250K Annually
Senior level
100K-250K Annually
Senior level
Information Technology • Business Intelligence • Consulting
Design and build Spark ETL pipelines on an AWS data platform, collaborate with stakeholders to deliver reliable large-scale data products, optimize and maintain data infrastructure, ensure data quality/governance, and manage platform operations and incident response.
Top Skills: Amazon RedshiftAmazon S3Aws EmrAws LambdaData WarehousingETLHadoopHadoop MapreduceHiveJavaPythonScalaSparkStreaming Pipelines
Reposted 2 Days AgoSaved
Remote or Hybrid
San Francisco Bay Area, CA
170K-190K Annually
Senior level
170K-190K Annually
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Biotech
The Lead Data Engineer will manage the AI Data Platform, scale data pipelines, ensure data quality, and lead technical strategy for data initiatives.
Top Skills: AirflowAWSAzureCloudFormationDagsterDaskDockerGCPKubernetesPrefectPythonSparkSQLTerraform
Reposted 4 Days AgoSaved
Remote
San Francisco Bay Area, CA
87K-102K Annually
Senior level
87K-102K Annually
Senior level
Real Estate
The Lead Data Engineer drives enterprise-scale data solutions, oversees project scoping, and leads a team, ensuring best practices in data engineering.
Top Skills: Azure DevopsAzure SqlDatabricksDelta LakeGitInfrastructure As CodePysparkPythonRScalaSpark Structured StreamingT-SqlUnity Catalog
12 Days AgoSaved
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Healthtech • Hospitality • Telehealth
The Lead Data Engineer will architect and develop a healthcare data platform on GCP, guiding teams in pipeline development, data modeling, and ensuring compliance with HIPAA. They will collaborate across functions, set technical directions, and mentor junior engineers.
Top Skills: AirflowApi GatewayAthenaAWSBigQueryCloud RunCloud StorageDataflowDbtDicomFhirGlueGoogle Cloud PlatformHl7KinesisLambdaPub/SubPythonRedshiftS3SQLStep Functions
Reposted 12 Days AgoSaved
Remote
San Francisco Bay Area, CA
Expert/Leader
Expert/Leader
Information Technology • Consulting
As a Lead Data Engineer, you'll optimize data workflows, manage data engineering projects, mentor junior engineers, and ensure robust data solutions meet business needs.
Top Skills: Apache AirflowSparkAws RedshiftAzure Synapse AnalyticsDatabricksGoogle Bigquery
Reposted 14 Days AgoSaved
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
130K-190K Annually
Senior level
130K-190K Annually
Senior level
Healthtech
The Lead Data Engineer will own the data platform, ensuring data quality, optimizing infrastructure, mentoring engineers, and collaborating with teams to create scalable data solutions.
Top Skills: AWSAzureDatabricksDbtGCPPalantir FoundryPysparkPythonSnowflake
Reposted 14 Days AgoSaved
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
185K-225K Annually
Senior level
185K-225K Annually
Senior level
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills: AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
Reposted YesterdaySaved
In-Office
San Francisco Bay Area, CA
260K-288K Annually
Senior level
260K-288K Annually
Senior level
Artificial Intelligence • Machine Learning • Generative AI
Build and maintain Lead-to-Opportunity Salesforce solutions, integrations, and data enrichment workflows. Troubleshoot production lead capture/routing issues, document processes, and collaborate cross-functionally to support GTM pipeline creation and lifecycle engagement.
Top Skills: ApexAPIsDevOpsSalesforceSalesforce Experience Cloud
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
Reposted 24 Days AgoSaved
In-Office
San Francisco Bay Area, CA
208K-260K Annually
Senior level
208K-260K Annually
Senior level
Information Technology • Consulting
As a Lead Data Engineer, you will design and maintain data platforms, oversee data ingestion pipelines, enforce standards, collaborate on solutions, and ensure best practices in healthcare data operations.
Top Skills: DatabricksPysparkPythonSQL
5 Days AgoSaved
In-Office
San Francisco Bay Area, CA
152K-244K Annually
Senior level
152K-244K Annually
Senior level
Healthtech • Biotech • Pharmaceutical
The Technical Lead will build software systems for AI-native drug discovery, design data pipelines, develop APIs, and collaborate with scientists to create efficient workflows and solutions.
Top Skills: AWSAzureC#DockerGCPGoJavaKubernetesMlflowPostgresPythonRedshiftRustSnowflakeSQLTypescript
21 Days AgoSaved
Remote
San Francisco Bay Area, CA
165K-175K Annually
Senior level
165K-175K Annually
Senior level
Mobile
Lead the reliability of the data platform, ensuring accuracy in data pipelines from ingestion to reporting, while mentoring junior data engineers.
Top Skills: DbtPythonSQL
3 Days AgoSaved
In-Office or Remote
San Francisco Bay Area, CA
180K-230K Annually
Senior level
180K-230K Annually
Senior level
Robotics
Lead the design and scaling of Serve's robotics data infrastructure, managing the lifecycle of data and mentoring engineers to enable real-time analytics and operations.
Top Skills: BigQueryC++DataflowDbtDockerGCPGcsGoKubernetesPub/SubPython
10 Days AgoSaved
In-Office or Remote
San Francisco Bay Area, CA
73K-171K Annually
Senior level
73K-171K Annually
Senior level
Information Technology
The Lead Full Stack Engineer will oversee software development lifecycle phases and lead a team of developers in migrating a Mainframe system to the Cloud.
Top Skills: .NetC#Data BricksKafka
Reposted 3 Days AgoSaved
Easy Apply
In-Office or Remote
San Francisco Bay Area, CA
Easy Apply
140K-200K Annually
Mid level
140K-200K Annually
Mid level
Artificial Intelligence • Information Technology • Machine Learning
As a Forward Deployed Engineer, you will design scalable data pipelines, optimize code for data processing, and collaborate with AI teams to meet their data needs.
Top Skills: Python
Reposted 14 Days AgoSaved
Remote
San Francisco Bay Area, CA
164K-257K Annually
Expert/Leader
164K-257K Annually
Expert/Leader
Big Data • Information Technology • Machine Learning • Sales • Software • Database • Generative AI
Lead the Web Data Acquisition team as a Principal Software Engineer, responsible for designing web crawling infrastructure and mentoring engineers.
Top Skills: Apache AirflowApache KafkaBigQueryGCPGkeJavaKubernetesPythonScrapySnowflakeStarburstTerraformTrinoVertex Ai
25 Days AgoSaved
Hybrid
San Francisco Bay Area, CA
Senior level
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Software
Lead and own the data science function: design and build production ML systems (recommendation, forecasting, segmentation), develop configurable multi-tenant models, run rigorous experimentation and causal analyses, connect model outputs to business impact, set scientific standards, and hire and mentor a high-velocity data science team.
Top Skills: A/B Testing InfrastructureExperimentation PlatformsFeature StoresModel ServingMonitoringOrchestrationPython
Reposted 21 Days AgoSaved
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
115K-145K Annually
Senior level
115K-145K Annually
Senior level
Big Data • Cloud • Professional Services • Database • Analytics • Business Intelligence • Consulting
The Lead Data Consultant will design and deliver scalable data solutions, manage project teams, and optimize client data environments, ensuring effective project execution and communication.
Top Skills: AWSBashBigQueryGCPLookerMicrosoft PowerbiPerlPythonRRedshiftSnowflakeSQLTableau
Reposted 22 Days AgoSaved
Remote
San Francisco Bay Area, CA
150K-182K Annually
Senior level
150K-182K Annually
Senior level
Cloud • Healthtech • Information Technology • Software • Consulting
As Staff Engineer, you will lead a data engineering team, architect data pipelines, mentor engineers, and optimize performance while ensuring system reliability and adherence to standards.
Top Skills: AWSDatabricksPysparkPython
Reposted 10 Days AgoSaved
In-Office
San Francisco Bay Area, CA
230K-385K Annually
Mid level
230K-385K Annually
Mid level
Artificial Intelligence • Machine Learning • Generative AI
The Data Engineer will design and manage data pipelines, develop datasets for product metrics, and collaborate with teams to ensure robust data integration and processing.
Top Skills: AirflowDagsterFlinkHadoopHdfsJavaPrefectPythonS3ScalaSpark
Reposted 16 Days AgoSaved
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
190K-220K Annually
Senior level
190K-220K Annually
Senior level
Blockchain
As a Senior Software Engineer, you'll architect systems, develop ETL pipelines, and design data models to support blockchain data analysis at petabyte scale. You'll collaborate with teams to enhance product offerings while ensuring high performance and availability.
Top Skills: AirflowBigQueryCitusDatadogDbtDockerFlinkIcerbergKafkaKubernetesPythonSparkSparksqlSQLStarrocksTerraformTrino
Reposted 10 Days AgoSaved
Remote or Hybrid
San Francisco Bay Area, CA
Senior level
Senior level
Big Data • Machine Learning • Software • Database • Analytics • Generative AI • Big Data Analytics
The role involves building and optimizing data pipelines, modeling datasets, applying machine learning techniques, and supporting data strategies. Candidates should have experience with Python, data lakes, warehousing, and related technologies.
Top Skills: Ai IdesAirflowAWSCircleCIDatabricksDockerElasticsearchGitPandasPostgresPysparkPythonSQLTerraform
All Filters
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account