Get the job you really want.
Maximum of 25 job preferences reached.
Top Lead Data Engineer Jobs in San Francisco, CA
Legal Tech • Software • Generative AI
The Lead Data Engineer will design and build the data warehouse, develop ETL/ELT pipelines, and establish data governance and quality practices while building a team to support data-driven growth.
Top Skills:
Ai-Assisted Development ToolsAirflowBigQueryData WarehouseDbtPrefectRedshiftSnowflakeSQL
3 Days AgoSaved
Consulting
The Lead Data Engineer will design, develop, and maintain ETL pipelines, ensuring effective data extraction, transformation, and loading from various sources, while collaborating with stakeholders and solving complex business issues.
Top Skills:
AWSAzureETLJavaPythonSnowflake
3 Days AgoSaved
Consulting
Seeking an ETL Engineer to design and maintain ETL pipelines, troubleshoot issues, and contribute to the data engineering team, working with various data sources and ensuring compliance with financial regulations.
Top Skills:
AWSAzureBi ToolsETLFlat FilesJavaPythonRelational DatabasesSnowflakeWeb Apis
Information Technology
The Lead Data Engineer/Architect designs and implements GCP solutions, focusing on data pipelines, architecture, and leadership in a client-facing role.
Top Skills:
Apache BeamBigQueryCi/CdCloud ComposerCloud FunctionsCloud StorageDataflowGoogle Cloud PlatformPub/SubPythonSQLTerraform
Information Technology • Business Intelligence • Consulting
Design and build Spark ETL pipelines on an AWS data platform, collaborate with stakeholders to deliver reliable large-scale data products, optimize and maintain data infrastructure, ensure data quality/governance, and manage platform operations and incident response.
Top Skills:
Amazon RedshiftAmazon S3Aws EmrAws LambdaData WarehousingETLHadoopHadoop MapreduceHiveJavaPythonScalaSparkStreaming Pipelines
Artificial Intelligence • Healthtech • Machine Learning • Biotech
The Lead Data Engineer will manage the AI Data Platform, scale data pipelines, ensure data quality, and lead technical strategy for data initiatives.
Top Skills:
AirflowAWSAzureCloudFormationDagsterDaskDockerGCPKubernetesPrefectPythonSparkSQLTerraform
Real Estate
The Lead Data Engineer drives enterprise-scale data solutions, oversees project scoping, and leads a team, ensuring best practices in data engineering.
Top Skills:
Azure DevopsAzure SqlDatabricksDelta LakeGitInfrastructure As CodePysparkPythonRScalaSpark Structured StreamingT-SqlUnity Catalog
Healthtech • Hospitality • Telehealth
The Lead Data Engineer will architect and develop a healthcare data platform on GCP, guiding teams in pipeline development, data modeling, and ensuring compliance with HIPAA. They will collaborate across functions, set technical directions, and mentor junior engineers.
Top Skills:
AirflowApi GatewayAthenaAWSBigQueryCloud RunCloud StorageDataflowDbtDicomFhirGlueGoogle Cloud PlatformHl7KinesisLambdaPub/SubPythonRedshiftS3SQLStep Functions
Information Technology • Consulting
As a Lead Data Engineer, you'll optimize data workflows, manage data engineering projects, mentor junior engineers, and ensure robust data solutions meet business needs.
Top Skills:
Apache AirflowSparkAws RedshiftAzure Synapse AnalyticsDatabricksGoogle Bigquery
Healthtech
The Lead Data Engineer will own the data platform, ensuring data quality, optimizing infrastructure, mentoring engineers, and collaborating with teams to create scalable data solutions.
Top Skills:
AWSAzureDatabricksDbtGCPPalantir FoundryPysparkPythonSnowflake
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills:
AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
Artificial Intelligence • Machine Learning • Generative AI
Build and maintain Lead-to-Opportunity Salesforce solutions, integrations, and data enrichment workflows. Troubleshoot production lead capture/routing issues, document processes, and collaborate cross-functionally to support GTM pipeline creation and lifecycle engagement.
Top Skills:
ApexAPIsDevOpsSalesforceSalesforce Experience Cloud
New
Track Smarter, Apply Better.
Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.
Use For Free
Information Technology • Consulting
As a Lead Data Engineer, you will design and maintain data platforms, oversee data ingestion pipelines, enforce standards, collaborate on solutions, and ensure best practices in healthcare data operations.
Top Skills:
DatabricksPysparkPythonSQL
Healthtech • Biotech • Pharmaceutical
The Technical Lead will build software systems for AI-native drug discovery, design data pipelines, develop APIs, and collaborate with scientists to create efficient workflows and solutions.
Top Skills:
AWSAzureC#DockerGCPGoJavaKubernetesMlflowPostgresPythonRedshiftRustSnowflakeSQLTypescript
Mobile
Lead the reliability of the data platform, ensuring accuracy in data pipelines from ingestion to reporting, while mentoring junior data engineers.
Top Skills:
DbtPythonSQL
Robotics
Lead the design and scaling of Serve's robotics data infrastructure, managing the lifecycle of data and mentoring engineers to enable real-time analytics and operations.
Top Skills:
BigQueryC++DataflowDbtDockerGCPGcsGoKubernetesPub/SubPython
Information Technology
The Lead Full Stack Engineer will oversee software development lifecycle phases and lead a team of developers in migrating a Mainframe system to the Cloud.
Top Skills:
.NetC#Data BricksKafka
Artificial Intelligence • Information Technology • Machine Learning
As a Forward Deployed Engineer, you will design scalable data pipelines, optimize code for data processing, and collaborate with AI teams to meet their data needs.
Top Skills:
Python
Big Data • Information Technology • Machine Learning • Sales • Software • Database • Generative AI
Lead the Web Data Acquisition team as a Principal Software Engineer, responsible for designing web crawling infrastructure and mentoring engineers.
Top Skills:
Apache AirflowApache KafkaBigQueryGCPGkeJavaKubernetesPythonScrapySnowflakeStarburstTerraformTrinoVertex Ai
Artificial Intelligence • Information Technology • Machine Learning • Software
Lead and own the data science function: design and build production ML systems (recommendation, forecasting, segmentation), develop configurable multi-tenant models, run rigorous experimentation and causal analyses, connect model outputs to business impact, set scientific standards, and hire and mentor a high-velocity data science team.
Top Skills:
A/B Testing InfrastructureExperimentation PlatformsFeature StoresModel ServingMonitoringOrchestrationPython
Big Data • Cloud • Professional Services • Database • Analytics • Business Intelligence • Consulting
The Lead Data Consultant will design and deliver scalable data solutions, manage project teams, and optimize client data environments, ensuring effective project execution and communication.
Top Skills:
AWSBashBigQueryGCPLookerMicrosoft PowerbiPerlPythonRRedshiftSnowflakeSQLTableau
Cloud • Healthtech • Information Technology • Software • Consulting
As Staff Engineer, you will lead a data engineering team, architect data pipelines, mentor engineers, and optimize performance while ensuring system reliability and adherence to standards.
Top Skills:
AWSDatabricksPysparkPython
Artificial Intelligence • Machine Learning • Generative AI
The Data Engineer will design and manage data pipelines, develop datasets for product metrics, and collaborate with teams to ensure robust data integration and processing.
Top Skills:
AirflowDagsterFlinkHadoopHdfsJavaPrefectPythonS3ScalaSpark
Blockchain
As a Senior Software Engineer, you'll architect systems, develop ETL pipelines, and design data models to support blockchain data analysis at petabyte scale. You'll collaborate with teams to enhance product offerings while ensuring high performance and availability.
Top Skills:
AirflowBigQueryCitusDatadogDbtDockerFlinkIcerbergKafkaKubernetesPythonSparkSparksqlSQLStarrocksTerraformTrino
Big Data • Machine Learning • Software • Database • Analytics • Generative AI • Big Data Analytics
The role involves building and optimizing data pipelines, modeling datasets, applying machine learning techniques, and supporting data strategies. Candidates should have experience with Python, data lakes, warehousing, and related technologies.
Top Skills:
Ai IdesAirflowAWSCircleCIDatabricksDockerElasticsearchGitPandasPostgresPysparkPythonSQLTerraform
Top San Francisco Companies Hiring Lead Data Engineers
See AllPopular Job Searches
All Filters
Total selected ()
No Results
No Results






















.png)











