Build and maintain scalable batch and streaming data pipelines on GCP, develop API-driven integrations, design data models, ensure data quality and performance, and deliver end-to-end solutions in a client-facing healthcare data environment.
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
-> Meet Egen
-> Life at Egen
-> Culture and Values at Egen
-> Career Development at Egen
We are looking for a Data Engineer with strong Google Cloud Platform (GCP) experience to join our growing data practice.
This is a hands-on, high-impact role focused on building scalable data platforms and API-driven integrations, particularly within the healthcare domain. You will have the opportunity to work on modern data architectures and deliver end-to-end solutions in a fast-paced, client-facing environment.
This is a hands-on, high-impact role focused on building scalable data platforms and API-driven integrations, particularly within the healthcare domain. You will have the opportunity to work on modern data architectures and deliver end-to-end solutions in a fast-paced, client-facing environment.
What You'll Do:
- Design and build scalable data pipelines (batch & streaming) on GCP
- Develop and manage API-driven integrations (REST, JSON, event-based)
- Work with healthcare data standards such as FHIR, HL7, and EDI
- Build and optimize solutions using: BigQuery, Dataflow, Pub/Sub, Cloud Storage
- Design data models aligned with business and domain requirements
- Ensure data quality, performance, and reliability
- Collaborate with stakeholders and independently own deliverables from design to deployment
What We're Looking For:
- 4-6 years of experience in Data Engineering
- Strong hands-on experience with GCP (BigQuery, Dataflow, Pub/Sub)
- Proficiency in Python and SQL
- Experience building data pipelines and distributed systems
- Experience with API development or integration
- Exposure to healthcare data systems (FHIR, HL7, EDI preferred)
- Ability to work independently with minimal supervision
- Strong problem-solving and communication skills
Nice-to-Have Skills:
- Experience with Airflow / Cloud Composer / dbt
- Exposure to real-time streaming architectures
- Multi-cloud experience (AWS/GCP)
- Prior experience in consulting or client-facing roles
Compensation & Benefits:
This role is eligible for our competitive salary and comprehensive benefits package to support your well-being:
- Comprehensive Health Insurance
- Paid Leave (Vacation/PTO)
- Paid Holidays
- Sick Leave
- Parental Leave
- Bereavement Leave
- 401 (k) Employer Match
- Employee Referral Bonuses
Check out our complete list of benefits here - >https://egen.ai/people/#benefits
Important: All roles are subject to standard hiring verification practices, which may include background checks, employment verification, and other relevant checks.
EEO and Accommodations:
Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and operate enterprise data pipelines and Lakehouse data products on Azure. Lead migrations, implement medallion architectures, optimize Spark and distributed SQL workloads, enforce CI/CD and observability, and support production incident response while partnering with architects, data scientists, and stakeholders.
Top Skills:
ArmAzure Ad / Entra IdAzure Data FactoryAzure Data Lake Storage Gen2Azure DatabricksAzure DevopsAzure Key VaultAzure MonitorAzure SqlAzure Synapse AnalyticsBashBicepDelta LakeKqlLog AnalyticsMicrosoft FabricPandasParquetPowershellPrivate EndpointsPysparkPytestPythonSpark SqlSsisSynapse Dedicated Sql PoolT-SqlTeradataTerraformUnity CatalogVnet
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills:
Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs
Artificial Intelligence • Big Data • Machine Learning
Design, build, and maintain scalable AWS-based data pipelines, data lakes and warehouses. Implement data modeling and warehousing for Redshift/Athena, ensure data quality, optimize queries, and develop production-grade Amazon QuickSight dashboards with security (RLS), performance tuning, and stakeholder-driven reporting.
Top Skills:
Amazon EmrAmazon QuicksightApache AirflowAws AthenaAws GlueAws LambdaAws RedshiftAws S3Aws Step FunctionsDirect QueryPower BIPysparkPythonQlikRow-Level SecuritySpiceSQLTableau
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
