Lead data engineering and machine learning initiatives by designing, architecting, developing, and supporting GCP data pipelines. Create information architecture documentation, estimate and plan technical work, collaborate with project teams and business analysts, and translate requirements into technical designs. Develop Python-based ELT pipelines, optimize BigQuery SQL, support CI/CD, and provide technical leadership to projects and teams.
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
-> Meet Egen
-> Life at Egen
-> Culture and Values at Egen
-> Career Development at Egen
About the opportunity:
Are you an experienced Data Engineer ready to make a significant impact on healthcare? Join our dynamic team in Nashville and help us revolutionize patient care through data-driven innovation.
As a Senior Data Engineer, you will play a pivotal role in driving our ML and data engineering initiatives. You will collaborate with cross-functional teams to design, develop, and deploy robust data solutions that enable data-driven decision-making and improve patient outcomes.
About the job:
- Design, architect, develop, support GCP data pipelines to extract, load, and transform data
- Maintain a holistic view of information assets by creating and maintaining artifacts that illustrate how information is stored, processed, and supported (i.e. documentation)
- Work with the project team, estimate and plan the work effort
- Attend daily team standups
- Work with business analysts and project management to review business requirements and and produce technical design specs that will meet the requirements
About you:
- 5+ years of hands-on experience as a Data Engineer or Data Architect
- Proven track record leading technical projects and teams
- Expert proficiency in Google Cloud Platform (GCP) tools, including: Google Cloud Storage (GCS), BigQuery, Cloud Composer/Airflow, Dataproc/Spark
- Strong data analysis and problem-solving skills
- Proficiency in a Business Intelligence (BI) tool
- Advanced SQL skills, including writing, tuning, and interpreting complex SQL queries
- Experience writing and maintaining Unix/Linux shell scripts
- Solid understanding of Data Build Tool (DBT)
- Experience with CI/CD pipelines
- Machine Learning experience
- Proficiency in developing Python-based ELT data pipelines
- Expertise in optimizing GCP BigQuery SQL queries and scripts
Compensation:
Compensation will be commensurate with experience and skills. We offer a competitive salary and benefits package, including health insurance, retirement plans, and professional development opportunities
EEO and Accommodations:
Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
Similar Jobs
Financial Services
Leads the design, development, testing, and optimization of large-scale data engineering solutions. Responsibilities include building Python and PySpark ETL pipelines, orchestrating workflows, developing AWS cloud-native services, managing data lakes and Snowflake environments, and implementing testing, CI/CD, and secure engineering practices. The role also promotes responsible AI-assisted development, mentors engineers, participates in code reviews, and drives technical delivery initiatives.
Top Skills:
Amazon AthenaAmazon CloudwatchApache AirflowApache FlinkApache IcebergAws GlueAws LambdaCi/CdClaudeControl-MDbtDelta LakeGithub CopilotJavaKafkaLlmsPrompt EngineeringPysparkPythonSnowflakeSQLVector Search
Big Data • Analytics • Energy • Renewable Energy
Develop and maintain data ingestion pipelines, relational databases, ETL/ELT workflows, cloud resources, data reliability monitoring, and AI-enhanced applications. Integrate LLM APIs and MCP connectors, write Python and R automation code, migrate siloed processes into centralized systems, and collaborate with technical and non-technical stakeholders. The role also supports Azure deployments, enterprise data integrations, dashboards, reporting, and cloud data security.
Top Skills:
AnthropicAzure Blob StorageAzure FunctionsAzure SqlGitLlm ApisMcpAzureMySQLOpenaiPostgresPower BIPythonRSalesforceSQLWorkday
.png)
Healthtech • Information Technology • Telehealth
Design and support ETL, data migration, transformation, import, export, and validation workflows for moving legacy EHR data into athenahealth systems. Build Python and SQL utilities, define source-to-target mappings, support HL7 and FHIR interoperability, validate EHI exports, investigate data quality issues, document processes, and collaborate with product, implementation, operations, sales, and engineering teams in a remote environment.
Top Skills:
Ehi ExportETLFhirHl7PythonSQL
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
