Design and build scalable data pipelines and integrations on Google Cloud, focusing on healthcare data standards and ensuring data quality and performance.
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
Meet Egen
Life at Egen
Culture and Values at Egen
Career Development at Egen
Benefits at Egen
About the opportunity:
We are looking for a Data Engineer with strong Google Cloud Platform (GCP) experience to join our growing data practice. This is a hands-on, high-impact role focused on building scalable data platforms and API-driven integrations, particularly within the healthcare domain. You will have the opportunity to work on modern data architectures and deliver end-to-end solutions in a fast-paced, client-facing environment.
What You'll Do
- Design and build scalable data pipelines (batch & streaming) on GCP
- Develop and manage API-driven integrations (REST, JSON, event-based)
- Work with healthcare data standards such as FHIR, HL7, and EDI
- Build and optimize solutions using: BigQuery, Dataflow, Pub/Sub, Cloud Storage
- Design data models aligned with business and domain requirements
- Ensure data quality, performance, and reliability
- Collaborate with stakeholders and independently own deliverables from design to deployment
What We're Looking For:
- 4-6 years of experience in Data Engineering
- Strong hands-on experience with GCP (BigQuery, Dataflow, Pub/Sub)
- Proficiency in Python and SQL
- Experience building data pipelines and distributed systems
- Experience with API development or integration
- Exposure to healthcare data systems (FHIR, HL7, EDI preferred)
- Ability to work independently with minimal supervision
- Strong problem-solving and communication skills
Nice to Have:
- Experience with Airflow / Cloud Composer / dbt
- Exposure to real-time streaming architectures
- Multi-cloud experience (AWS/GCP)
- Prior experience in consulting or client-facing roles
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Senior Data Engineer will design and maintain data pipelines, optimize data frameworks, and collaborate with teams to deliver scalable data solutions, primarily using Python, SQL, and cloud technologies.
Top Skills:
Apache AirflowAWSAzureDatabricksDockerGCPKubernetesMicrosoft PurviewPysparkPythonSnowflakeSQL
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Senior Data Engineer designs and builds scalable data pipelines, optimizes ETL/ELT workflows, resolves data quality issues, and collaborates with stakeholders for healthcare data integration.
Top Skills:
Azure Data FactoryFhirGitGo-AnywhereHl7NcpdpPowershellPythonSnowflake Sql
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
The Senior Data Engineer develops ETL/ELT pipelines and data solutions for lab operations, focusing on collaboration and continuous improvement in data processing.
Top Skills:
AirflowAWSAzureGitGitPandasPower BIPythonSparkSQL
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
