Top Lead Data Engineer Jobs in San Francisco, CA

16 Days AgoSaved
Remote
San Francisco Bay Area, CA
174K-230K Annually
Mid level
174K-230K Annually
Mid level
Insurance • Legal Tech • Social Impact
As the first in-house Data Engineer, you will own the data infrastructure, build and maintain data pipelines, and collaborate with teams to ensure quality data access and insights.
Top Skills: AirflowBigQueryDagsterDbtGoPythonSQL
Reposted 11 Hours AgoSaved
Hybrid
San Francisco Bay Area, CA
150-200 Annually
Mid level
150-200 Annually
Mid level
Information Technology
The Lead Data Engineer/Architect designs and implements GCP solutions, focusing on data pipelines, architecture, and leadership in a client-facing role.
Top Skills: Apache BeamBigQueryCi/CdCloud ComposerCloud FunctionsCloud StorageDataflowGoogle Cloud PlatformPub/SubPythonSQLTerraform
Reposted 11 Hours AgoSaved
Easy Apply
Remote or Hybrid
San Francisco Bay Area, CA
Easy Apply
200K-215K Annually
Expert/Leader
200K-215K Annually
Expert/Leader
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Lead the development of healthcare applications and data systems, focusing on audience intelligence and compliance. Design scalable data pipelines, APIs, and reporting systems while ensuring high data quality and security in regulated environments.
Top Skills: AWSAzureDockerFlinkGCPJavaKafkaKubernetesPythonReactRubySpark
Reposted 4 Days AgoSaved
Remote
San Francisco Bay Area, CA
87K-102K Annually
Senior level
87K-102K Annually
Senior level
Real Estate
The Lead Data Engineer drives enterprise-scale data solutions, oversees project scoping, and leads a team, ensuring best practices in data engineering.
Top Skills: Azure DevopsAzure SqlDatabricksDelta LakeGitInfrastructure As CodePysparkPythonRScalaSpark Structured StreamingT-SqlUnity Catalog
13 Days AgoSaved
In-Office
San Francisco Bay Area, CA
173K-286K Annually
Senior level
173K-286K Annually
Senior level
Cloud • Software
The Lead Data Engineer will design and architect data retrieval systems, build inference infrastructure, improve data quality, and mentor a specialized team to enhance customer success through AI integration.
Top Skills: AirflowAWSAzureDbtGCPInformaticaPythonSparkSQL
Reposted 7 Days AgoSaved
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Healthtech • Hospitality • Telehealth
The Lead Data Engineer will architect and develop a healthcare data platform on GCP, guiding teams in pipeline development, data modeling, and ensuring compliance with HIPAA. They will collaborate across functions, set technical directions, and mentor junior engineers.
Top Skills: AirflowApi GatewayAthenaAWSBigQueryCloud RunCloud StorageDataflowDbtDicomFhirGlueGoogle Cloud PlatformHl7KinesisLambdaPub/SubPythonRedshiftS3SQLStep Functions
Reposted 7 Days AgoSaved
Remote
San Francisco Bay Area, CA
Expert/Leader
Expert/Leader
Information Technology • Consulting
As a Lead Data Engineer, you'll optimize data workflows, manage data engineering projects, mentor junior engineers, and ensure robust data solutions meet business needs.
Top Skills: Apache AirflowSparkAws RedshiftAzure Synapse AnalyticsDatabricksGoogle Bigquery
24 Days AgoSaved
In-Office or Remote
San Francisco Bay Area, CA
225K-290K Annually
Expert/Leader
225K-290K Annually
Expert/Leader
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
As a Lead Security Engineer, you will architect and manage Circle's security data platform, ensuring robust data ingestion, normalization, and response strategies while collaborating on security operations initiatives.
Top Skills: AthenaAWSGlueKafkaMskPythonS3SQL
Reposted 9 Days AgoSaved
Remote
San Francisco Bay Area, CA
185K-225K Annually
Senior level
185K-225K Annually
Senior level
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills: AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
Reposted 19 Days AgoSaved
In-Office
San Francisco Bay Area, CA
208K-260K Annually
Senior level
208K-260K Annually
Senior level
Information Technology • Consulting
As a Lead Data Engineer, you will design and maintain data platforms, oversee data ingestion pipelines, enforce standards, collaborate on solutions, and ensure best practices in healthcare data operations.
Top Skills: DatabricksPysparkPythonSQL
Reposted 3 Days AgoSaved
In-Office
San Francisco Bay Area, CA
167K-266K Annually
Senior level
167K-266K Annually
Senior level
Healthtech • Biotech • Pharmaceutical
The Scientific Data Engineer will design data architecture, build ETL/ELT pipelines, implement data quality checks, and develop semantic layers for AI-consumable data products in healthcare research.
Top Skills: AirflowAmazon NeptuneAthenaAWSDatabricksDbtGlueNeo4JPythonRedshiftS3SnowflakeSparkSQL
8 Days AgoSaved
In-Office
San Francisco Bay Area, CA
173K-286K Annually
Senior level
173K-286K Annually
Senior level
Cloud • Software
The Lead Agentic Data Systems Engineer will design and maintain autonomous agents for data management and problem resolution, ensuring product delivery and governance with a focus on AI-driven workflows.
Top Skills: Advanced SqlAirflowSparkDbtDockerKubernetesPythonSnowflake
New

Cut your apply time in half.

Use ourAI Assistantto automatically fill your job applications.

Use For Free
Application Tracker Preview
Reposted 23 Days AgoSaved
Remote or Hybrid
San Francisco Bay Area, CA
170K-190K Annually
Senior level
170K-190K Annually
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Biotech
The Lead Data Engineer will manage the AI Data Platform, scale data pipelines, ensure data quality, and lead technical strategy for data initiatives.
Top Skills: AirflowAWSAzureCloudFormationDagsterDaskDockerGCPKubernetesPrefectPythonSparkSQLTerraform
Reposted 24 Days AgoSaved
In-Office or Remote
San Francisco Bay Area, CA
150K-175K Annually
Mid level
150K-175K Annually
Mid level
Insurance
The Lead Data Engineer will design and build scalable data pipelines on Databricks, develop ETL/ELT pipelines with PySpark, and mentor engineering teams for data transformation and analytics.
Top Skills: DatabricksPysparkPythonSQL
Reposted 16 Days AgoSaved
In-Office
San Francisco Bay Area, CA
152K-244K Annually
Senior level
152K-244K Annually
Senior level
Healthtech • Biotech • Pharmaceutical
The Technical Lead will build software systems for AI-native drug discovery, design data pipelines, develop APIs, and collaborate with scientists to create efficient workflows and solutions.
Top Skills: AWSAzureC#DockerGCPGoJavaKubernetesMlflowPostgresPythonRedshiftRustSnowflakeSQLTypescript
7 Days AgoSaved
Remote
San Francisco Bay Area, CA
96K-139K Annually
Senior level
96K-139K Annually
Senior level
Information Technology
The Data Architect/Data Governance Lead supports the Medicaid Enterprise Data Warehouse by leading data architecture, metadata management, and governance processes, ensuring compliance and scalability.
Top Skills: AWSAzureBi ToolsCognosDataedoETLGCPIicsInformaticaOraclePostgresPower BISnowflakeSQL ServerSsisTableauTalend
Reposted 17 Days AgoSaved
Hybrid
San Francisco Bay Area, CA
200K-250K Annually
Senior level
200K-250K Annually
Senior level
Healthtech
Lead the architecture and implementation of data integrations with healthcare payers, build data pipelines for AI/ML systems, and establish engineering best practices.
Top Skills: AWSCeleryClickhouseDjangoDockerNextjsPostgresPythonS3Typescript
8 Days AgoSaved
Remote
San Francisco Bay Area, CA
136K-223K Annually
Expert/Leader
136K-223K Annually
Expert/Leader
Security • Software • Cybersecurity
As a Lead Enterprise AI Data Engineer, you will design and build scalable data pipelines and AI tooling, enabling data-driven decision making in collaboration with business stakeholders and data scientists.
Top Skills: Apache BeamSparkAWSDatabricksDockerGCPJavaKafkaPythonScikit-LearnSnowflakeTensorFlowTerraform
Reposted 19 Days AgoSaved
Hybrid
San Francisco Bay Area, CA
Senior level
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Software
Lead and own the data science function: design and build production ML systems (recommendation, forecasting, segmentation), develop configurable multi-tenant models, run rigorous experimentation and causal analyses, connect model outputs to business impact, set scientific standards, and hire and mentor a high-velocity data science team.
Top Skills: A/B Testing InfrastructureExperimentation PlatformsFeature StoresModel ServingMonitoringOrchestrationPython
Reposted 21 Days AgoSaved
In-Office
San Francisco Bay Area, CA
260K-288K Annually
Senior level
260K-288K Annually
Senior level
Artificial Intelligence • Machine Learning • Generative AI
Build and maintain Lead-to-Opportunity Salesforce solutions, integrations, and data enrichment workflows. Troubleshoot production lead capture/routing issues, document processes, and collaborate cross-functionally to support GTM pipeline creation and lifecycle engagement.
Top Skills: ApexAPIsDevOpsSalesforceSalesforce Experience Cloud
One Month AgoSaved
Remote
San Francisco Bay Area, CA
137K-180K Annually
Senior level
137K-180K Annually
Senior level
Aerospace • Defense • Manufacturing
The Lead Data Engineer will develop a data service for command and control software, ensuring high-quality code and system integration while collaborating with various teams in a highly complex DoD context.
Top Skills: Apache KafkaApache NifiApache PulsarBashDockerDocker-ComposeGitJavaJenkinsKubernetesMicrok8SPostgisPostgresPythonRabbitMQRke2Typescript
Reposted 5 Days AgoSaved
In-Office
San Francisco Bay Area, CA
230K-385K Annually
Mid level
230K-385K Annually
Mid level
Artificial Intelligence • Machine Learning • Generative AI
The Data Engineer will design and manage data pipelines, develop datasets for product metrics, and collaborate with teams to ensure robust data integration and processing.
Top Skills: AirflowDagsterFlinkHadoopHdfsJavaPrefectPythonS3ScalaSpark
Reposted 5 Days AgoSaved
Remote or Hybrid
San Francisco Bay Area, CA
Senior level
Senior level
Big Data • Machine Learning • Software • Database • Analytics • Generative AI • Big Data Analytics
The role involves building and optimizing data pipelines, modeling datasets, applying machine learning techniques, and supporting data strategies. Candidates should have experience with Python, data lakes, warehousing, and related technologies.
Top Skills: Ai IdesAirflowAWSCircleCIDatabricksDockerElasticsearchGitPandasPostgresPysparkPythonSQLTerraform
Reposted 17 Days AgoSaved
In-Office or Remote
San Francisco Bay Area, CA
Mid level
Mid level
Software
The Senior Data Engineer will build and deploy data pipelines, develop warehouse architectures, and design analytics solutions for the team.
Top Skills: AirflowAWSBigQueryDbtDockerGitMeltanoMongoDBMySQLOraclePostgresPythonRedshiftSnowflakeSQLSQL ServerSuperset
Reposted 23 Days AgoSaved
In-Office or Remote
San Francisco Bay Area, CA
140K-200K Annually
Mid level
140K-200K Annually
Mid level
Artificial Intelligence • Information Technology • Machine Learning
As a Forward Deployed Engineer, you will design scalable data pipelines, optimize code for data processing, and collaborate with AI teams to meet their data needs.
Top Skills: Python
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account