Machinify Logo

Machinify

Data Engineering Manager

Reposted 2 Days Ago
In-Office or Remote
Hiring Remotely in Palo Alto, CA
Senior level
In-Office or Remote
Hiring Remotely in Palo Alto, CA
Senior level
Lead a team of Data Engineers to transform data into actionable insights, involving pipeline design, project management, and mentorship for high-quality data solutions.
The summary above was generated by AI

Machinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country. Deployed by over 60 health plans, including many of the top 20, and representing more than 160 million lives, Machinify brings together a fully configurable and content-rich, AI-powered platform along with best-in-class expertise. We’re constantly reimagining what’s possible in our industry, creating disruptively simple, powerfully clear ways to maximize financial outcomes and drive down healthcare costs.

Why this role matters

As a Data Engineering Manager, you will lead a high-performing team responsible for transforming raw external and customer data into actionable, trusted datasets. Your team’s work powers product decisions, ML models, operational dashboards, and client integrations.

You’ll combine hands-on technical expertise with people and project leadership, reviewing and designing production pipelines, mentoring engineers, and driving best practices. You will also be a key cross-functional partner, collaborating with product managers, Server teams, Platform teams, UI teams, SMEs, account managers, analytics teams, ML/DS teams, and customer success to ensure data is accurate, reliable, and impactful.

This is a high-visibility role with both strategic and tactical impact — shaping data workflows, onboarding new customers, and scaling the team as the company grows.

What You’ll Do
  • Lead, mentor, and grow a high-performing team of Data Engineers, fostering technical excellence, collaboration, and career growth.

  • Own the design, review, and optimization of production pipelines, ensuring high performance, reliability, and maintainability.

  • Drive customer data onboarding projects, standardizing external feeds into canonical models.

  • Collaborate with senior leadership to define team priorities, project roadmaps, and data standards, translating objectives into actionable assignments for your team.

  • Lead sprint planning and work with cross-functional stakeholders to prioritize initiatives that improve customer metrics and product impact.

  • Partner closely with Product, ML, Analytics, Engineering, and Customer teams to translate business needs into effective data solutions.

  • Ensure high data quality, observability, and automated validations across all pipelines.

  • Contribute hands-on when necessary to architecture, code reviews, and pipeline design.

  • Identify and implement tools, templates, and best practices that improve team productivity and reduce duplication.

  • Build cross-functional relationships to advocate for data-driven decision-making and solve complex business problems.

  • Hire, mentor, and develop team members, fostering a culture of innovation, collaboration, and continuous improvement.

  • Communicate technical concepts and strategies effectively to both technical and non-technical stakeholders.

  • Measure team impact through metrics and KPIs, ensuring alignment with company goals.

What You Bring
  • Degree in Computer Science, Engineering, or a related field.

  • 3+ years of combined technical leadership and engineering management experience, preferably in a startup, with a proven track record of managing data teams and delivering high-impact projects from concept to deployment.

  • 10+ years of experience in data engineering, including building and maintaining production pipelines and distributed computing frameworks.

  • Strong expertise in Python, Spark, SQL, and Airflow

  • Hands-on experience in pipeline architecture, code review, and mentoring junior engineers.

  • Prior experience with customer data onboarding and standardizing non-canonical external data.

  • Deep understanding of distributed data processing, pipeline orchestration, and performance tuning.

  • Exceptional ability to manage priorities, communicate clearly, and work cross-functionally, with experience building and leading high-performing teams.

  • Demonstrated experience leading small teams, including performance management and career development.

  • Comfortable with ambiguity, taking initiative, thinking strategically, and executing methodically.

  • Ability to drive change, inspire distributed teams, and solve complex problems with a data-driven mindset.

  • Customer-oriented, ensuring work significantly advances product value and impact.

Bonus:

  • Familiarity with healthcare data (837/835 claims, EHR, UB04).

  • Experience with cloud platforms (AWS/GCP), databricks , streaming frameworks (Kafka/SQS), and containerized workflows (Docker/Kubernetes).

  • Experience building internal DE tooling, frameworks, or SDKs to improve team productivity.

Why you'll love working here
  • High Impact: Your team’s work powers key decisions across product, ML, operations, and customer-facing initiatives.

  • Ownership & Growth: Influence the data platform and pipeline architecture while mentoring a growing team.

  • Cross-Functional Exposure: Work with product, platform, engineering , ML, analytics, and customer teams to solve meaningful problems.

  • Remote Flexibility: Fully remote with opportunities to collaborate across teams.

Early Builder Advantage: Shape processes, standards, and practices as we scale.

Equal Employment Opportunity at Machinify

Machinify is committed to hiring talented and qualified individuals with diverse backgrounds for all of its positions. Machinify believes that the gathering and celebration of unique backgrounds, qualities, and cultures enriches the workplace. 

See our Candidate Privacy Notice at: https://www.machinify.com/candidate-privacy-notice/

Top Skills

Airflow
AWS
Databricks
Docker
GCP
Kafka
Kubernetes
Python
Spark
SQL
Sqs
HQ

Machinify Palo Alto, California, USA Office

Downtown Palo Alto is known for its lively style, trendy shops, plenty of bars, restaurants and great coffee stores. The office is easy to get to, and just a couple of minutes walk from the Caltrain station.

Similar Jobs

Yesterday
Easy Apply
Remote
United States
Easy Apply
191K-265K Annually
Senior level
191K-265K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Lead analytics engineering for finance data, delivering governed models and reporting solutions, improving data quality and controls, and partnering with multiple stakeholders.
Top Skills: DbtSigmaSnowflakeWorkiva
3 Days Ago
Remote
United States of America
225K-290K Annually
Senior level
225K-290K Annually
Senior level
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
Lead and manage the Data Engineering team, setting strategy and vision while ensuring delivery of reliable and scalable data solutions. Serve as a technical leader and mentor, collaborating with cross-functional partners to enable data-driven decision-making and automation using AI.
Top Skills: AirflowAWSAzureBigQueryDagsterDatabricksDbtGCPJavaPythonScalaSnowflakeSQL
2 Days Ago
Easy Apply
Remote
USA
Easy Apply
225K-260K Annually
Senior level
225K-260K Annually
Senior level
Fintech • Real Estate
Lead the Data Engineering team, managing platform strategy, delivering high-quality systems, and fostering collaboration across teams to enhance data capabilities.
Top Skills: AWSDbtKafkaPythonSigmaSnowflakeTypescript

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account