Get the job you really want.
Maximum of 25 job preferences reached.
Top Lead Data Engineer Jobs in San Francisco, CA
Information Technology • Consulting
As a Lead Data Engineer, you will design and maintain data platforms, oversee data ingestion pipelines, enforce standards, collaborate on solutions, and ensure best practices in healthcare data operations.
Top Skills:
DatabricksPysparkPythonSQL
Information Technology
The Lead Data Engineer/Architect designs and implements GCP solutions, focusing on data pipelines, architecture, and leadership in a client-facing role.
Top Skills:
Apache BeamBigQueryCi/CdCloud ComposerCloud FunctionsCloud StorageDataflowGoogle Cloud PlatformPub/SubPythonSQLTerraform
Information Technology
The Senior Lead Data Engineer will architect and maintain ELT pipelines, manage data infrastructure, optimize SQL queries, and mentor teammates.
Top Skills:
Apache AirflowHadoopPythonSpark SqlSQLUnix
HR Tech • Payments • Software • Financial Services
As Lead Data Engineer, you will design and build Benepass's data infrastructure, partner with teams to deliver data capabilities, and set the vision for data engineering. You'll ensure data governance and manage pipelines in an AWS environment while preparing for future team growth.
Top Skills:
AirflowAWSDagsterDbtKafkaKinesisPythonRdsRedshiftS3SQL
Artificial Intelligence • Other • Security • Software • Analytics • Big Data Analytics
Lead Data & AI Engineer responsible for architecting and implementing intelligent analytics for a surveillance cloud platform, requiring strong skills in data pipelines, AI model management, and modern cloud technologies.
Top Skills:
DockerGCPGoGrpcIcebergK8SPythonSparkTerraformTriton
Artificial Intelligence • Healthtech • Machine Learning • Biotech
The Lead Data Engineer will manage the AI Data Platform, scale data pipelines, ensure data quality, and lead technical strategy for data initiatives.
Top Skills:
AirflowAWSAzureCloudFormationDagsterDaskDockerGCPKubernetesPrefectPythonSparkSQLTerraform
Reposted 16 Days AgoSaved
Consulting
The Lead Data Engineer is responsible for designing, developing, and maintaining ETL pipelines to manage financial data, ensuring compliance and business intelligence.
Top Skills:
AWSAzureETLJavaPythonSnowflake
Information Technology • Consulting
As a Lead Data Engineer, you'll optimize data workflows, manage data engineering projects, mentor junior engineers, and ensure robust data solutions meet business needs.
Top Skills:
Apache AirflowSparkAws RedshiftAzure Synapse AnalyticsDatabricksGoogle Bigquery
Artificial Intelligence • Information Technology • Software
Design and maintain high-scale data infrastructure, build ETL pipelines, integrate data sources, optimize performance, and collaborate with data scientists.
Top Skills:
AirflowAWSBigQueryClickhouseDagsterDbtGCPPrefectPythonRedshiftSnowflakeSQL
Fintech • Financial Services
The Lead Data Engineer will onboard customers to the data warehouse, analyze data use cases, and implement improvements using modern cloud-native technologies. Responsibilities include collaborating with various teams, ensuring data quality, and automating processes for efficient analytics and infrastructure designs.
Top Skills:
AWSKafkaPrestoSnowflakeSparkTableau
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills:
AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
Artificial Intelligence • Software • Generative AI
Lead Glean's engineering team in building and scaling enterprise data management systems, collaborating on product initiatives and delivering robust solutions.
Top Skills:
AIBackend ServicesDistributed Systems
New
Track Smarter, Apply Better.
Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.
Use For Free
Healthtech
The Lead Data Engineer will own the data platform, ensuring data quality, optimizing infrastructure, mentoring engineers, and collaborating with teams to create scalable data solutions.
Top Skills:
AWSAzureDatabricksDbtGCPPalantir FoundryPysparkPythonSnowflake
Software
Lead the data strategy at Edmentum by designing scalable data pipelines, optimizing data systems, and mentoring junior engineers while ensuring compliance with data governance policies.
Top Skills:
AWSAzureETLGCPHadoopPythonSparkSQL
Fintech • Software
The Lead, Data Engineer leads the data engineering team, designing scalable data solutions, mentoring staff, and ensuring data quality while collaborating with stakeholders to meet business goals.
Top Skills:
Data ArchitecturesData EngineeringData GovernanceData PipelinesSnowpro Core Certification
Software • Energy
Lead the design and development of data integration solutions and APIs, ensuring performance and security. Oversee software lifecycle, mentor juniors, and contribute to code reviews while resolving complex technical issues.
Top Skills:
AWSAws LambdaDockerHibernateJavaJavaScriptJmsJunitKubernetesLinuxMavenMockitoMySQLRdbmsRestSoapSpring BatchSpring BootSpring IntegrationTestng
Artificial Intelligence • Cybersecurity
Design, build, and maintain scalable data infrastructure in the cloud using AWS services and Infrastructure as Code to ensure data reliability and performance.
Top Skills:
AWSCi/CdDmsDockerGitKubernetesPythonRedshiftS3Terraform
Artificial Intelligence • Software • Analytics • Financial Services
Lead the backend API team, architect large-scale data systems, ensure reliable API performance, mentor engineers, and drive engineering best practices.
Top Skills:
AWSClickhouseNode.js
Fintech • Software • Financial Services
Lead Data Engineer responsible for architecting, scaling, and optimizing data pipelines to support Tidal's ETF platform, ensuring high-performance data delivery and collaboration with cross-functional teams.
Top Skills:
AirflowAWSDbtGitGitKafkaKinesisPrefectPythonRedshiftSnowflakeSQL
Marketing Tech • Design
The Lead Data/ML Engineer will design and maintain scalable data pipelines and AI systems, ensuring data reliability and collaboration with product teams.
Top Skills:
PythonSnowflakeTemporal
Software
The Senior Data Engineer will build and deploy data pipelines, develop warehouse architectures, and design analytics solutions for the team.
Top Skills:
AirflowAWSBigQueryDbtDockerGitMeltanoMongoDBMySQLOraclePostgresPythonRedshiftSnowflakeSQLSQL ServerSuperset
Artificial Intelligence • Information Technology • Machine Learning
As a Forward Deployed Engineer, you will design scalable data pipelines, optimize code for data processing, and collaborate with AI teams to meet their data needs.
Top Skills:
Python
Fintech • Information Technology
As a Staff Engineer and Team Lead, you will architect scalable backend systems, mentor engineers, and ensure high-quality code for Alpaca's market data suite.
Top Skills:
GoGoogle Cloud PlatformKubernetesLinuxPostgresTcp/IpUdp
Reposted 7 Days AgoSaved
Easy Apply
Easy Apply
Information Technology • Machine Learning • Natural Language Processing • Security • Software • Analytics • Cybersecurity
Join Recorded Future's Talent Network as a Data Engineer, focusing on Python, ETL pipelines, and web scraping. Stay updated for future opportunities.
Top Skills:
AWSBeautifulsoupDaskElasticsearchFasttextFlaskGitGrafanaInfluxdbJupyterKibanaMongodbPrefectPythonRabbitMQReactRedshiftSckikit-LearnSeleniumSentrySpacyWord2Vec
Productivity • Security • Software • Business Intelligence • Cybersecurity
The role involves designing and implementing software solutions for data integration and building scalable data platforms. Responsibilities include enhancing data systems and promoting software engineering best practices.
Top Skills:
AirflowAWSAzureDagsterDelta LakeGCPMySQLSnowflake
Top San Francisco Companies Hiring Lead Data Engineers
See AllPopular Job Searches
All Filters
Total selected ()
No Results
No Results




.png)








.png)









.png)












