Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance, and collaborating with teams to meet data needs.
About the Role
We are seeking an experienced Senior Data Engineer to join our growing IT team. This role will be responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support our organization’s data needs.
Specific Responsibilities:- Design, develop, and maintain robust data pipelines and infrastructure to support data integration, processing, and storage
- Collaborate with analysts and other stakeholders to understand data requirements and translate them into technical solutions
- Implement best practices for data governance, security, and quality assurance to ensure the reliability and accuracy of data
- Explore and evaluate new technologies and tools to enhance our data infrastructure and capabilities
- Design and implement complex data models on Azure Synapse Analytics to support data warehousing Utilize Azure DevOps for continuous integration, continuous delivery, and agile project management.
- Manage and optimize Apache Spark pools for high-performance data processing tasks.
- Develop and maintain ETL processes and data pipelines using Python scripting.
- Ensure data quality and integrity across all platforms and systems.
- Collaborate with cross-functional teams to translate business needs into technical specifications.
- Stay current with industry trends and advancements in Azure data services.
- Bachelor’s degree in Computer Science, Engineering, or related field
- Minimum of 5+ years experience in data engineering roles, with a strong focus on building and maintaining data pipelines and infrastructure
- Strong proficiency in Azure Synapse Analytics, Azure DevOps, and Apache Spark pools.
- Expertise in Python scripting and other programming languages such as SQL and Java
- Senior level knowledge of data modeling, processes, and data warehouse concepts
- Strong communication skills and ability to effectively communicate technical concepts to non-technical stakeholders
- Experience with data modeling, warehousing, and building ETL pipelines
- Familiarity with Azure Data Factory, Azure Data Lake Storage, and other Azure data services
Health-E Commerce's compensation philosophy is grounded in market data and internal equity to ensure fairness and consistency across the team. Individuals new to the company should generally expect offers to fall between the entry point and midpoint of the salary range. Our goal is to provide an offer that supports growth potential within the role and allows for future salary progression.
- Compensation: $130,000 - 155,000
- Discretionary Annual Bonus Eligibility: Up to 10%
- Medical, Dental, Vision, and 401K with a company match
- Dependent Care, FSA & HSA accounts
- Paid Parental & Bonding Leave
- Flexible PTO & office closure on all major holidays
- Monthly wellness & internet reimbursements
- Professional development including certification support & leadership coaching
- Mental Health resources
- 100% remote within the United States
- Must be able to work EST hours
Candidate Privacy Notice
Similar Jobs
Healthtech • Social Impact • Software • Telehealth
Build and maintain scalable, secure data pipelines and platforms to enable AI-driven analytics. Partner with analytics, product, and marketing to translate requirements, deploy production systems, implement data governance and access controls, and support AI applications at scale.
Top Skills:
AWSIcebergKafkaLarge Language Models (Llms)Model Context Protocols (Mcps)PythonSemantic LayersSnowflakeSparkSQLTerraform
Fintech • Software • Financial Services
Design, build, and maintain scalable batch and real-time data pipelines and data lake architecture. Improve observability and SLOs, optimize ETL/ELT, develop dbt workflows, support event-driven architectures, integrate financial APIs, and collaborate with analytics and ML teams to deliver reliable, model-ready data products.
Top Skills:
AirflowApache IcebergAvroAws AthenaAws GlueAws KinesisAws S3BigQueryCi/CdCloud SqlCloud StorageDbtEmrGCPGitopsParquetPrefectPythonSQLTerraform
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.
Top Skills:
Ai AgentsApache IcebergAuroraAWSAws RdsAzureDatabricksDbtFivetranGCPGoogle BigqueryMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonSnowflakeSparkSQL
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
