Mill Logo

Mill

Data Engineer - Data Platform

Posted 2 Months Ago
Hybrid
San Bruno, CA, USA
185K-210K Annually
Mid level
Hybrid
San Bruno, CA, USA
185K-210K Annually
Mid level
Build and maintain scalable production data pipelines, infrastructure, warehouse models, analytics platforms, and data-quality systems. Partner with software engineers to instrument product features and ensure reliable event data. Support Hex and Snowflake self-serve analytics, maintain business metrics and data logic, and develop monitoring, validation, alerting, and observability tooling. The role also collaborates with product, analytics, marketing, and engineering teams, with potential future exposure to recommendation and LLM-based product work.
The summary above was generated by AI

Mill is a waste prevention technology company reimagining what it means to eliminate waste, starting with food. We build smart systems and infrastructure for homes, businesses, and municipalities that transform food scraps from landfill-bound waste into valuable resources, including chicken feed. Tens of thousands of Mill’s residential food recyclers are already helping households divert millions of pounds of food scraps every year, paving the way for our upcoming launch of Mill Commercial—the industry’s first end-to-end solution for managing, understanding, and preventing food waste in commercial environments (e.g. grocery, restaurants, food services). At Mill, we are passionate about building easy-to-use, beautifully designed technologies that keep food in the food system and out of landfills.

The Role

As a Data Engineer at Mill, you'll build and maintain the core data infrastructure that powers analytics and product data across the company — ingestion pipelines, warehouse modeling, data quality, and the self-serve analytics platform (Hex + Snowflake) our business teams rely on. You'll work closely with the Senior Data Engineer owning our recommendations platform, contributing to and supporting that work as needed, with the opportunity to grow into deeper recommendation/LLM-based work over time. You'll partner closely with product, engineering, data analytics, and marketing teams.

What You'll Do
  • Design, build, and maintain scalable data pipelines across Mill's product and operational systems
  • Manage and maintain data infrastructure that powers our product and operational systems, ensuring it's reliable and ready to feed external customers and downstream analytics
  • Collaborate with software engineers to instrument new product features and ensure event data flows cleanly 
  • Help build and maintain the self-serve analytics platform in Hex and Snowflake for internal business teams
  • Help maintain the metrics, table endorsements, and business logic that analysts and stakeholders rely on
  • Own data quality monitoring — build alerting, validation frameworks, and observability tooling so data issues get caught before they become business problems
What We're Looking For
  • 3-5 years of experience operating data engineering systems in production
  • Have built and operated data pipelines in production using Python, SQL, and tools like dbt, Airflow, Fivetran, or similar against a cloud data warehouse (e.g., Snowflake)
  • Have used Infrastructure as Code (e.g., Terraform, Pulumi) to provision and manage data infrastructure, with CI/CD discipline for pipeline and infra changes (automated testing, staged rollout, rollback)
  • Experience working with transactional databases (e.g., PostgreSQL, Amazon RDS) as a data source, including understanding how OLTP systems differ from warehouse/analytical workloads
  • Comfort working in a collaborative environment where data consumers are partners, not just stakeholders, and comfort moving between different types of work as priorities shift
  • A bias toward action
Nice to Have
  • Exposure to recommendation, personalization, or LLM-based product logic — not required, but a strong plus given the team's direction
  • Experience building or supporting self-serve analytics tooling (Hex, Looker, or similar)
  • Exposure to distributed systems concepts (partitioning, consistency, fault tolerance)
  • Experience with Mixpanel, Tableau, or similar BI/analytics tools
  • Familiarity with data contract or data mesh patterns, or RBAC/access governance on a warehouse
  • Experience with event tracking or product analytics

The estimated base salary range for this position is $185k to $210k, which does not include the value of benefits or a potential equity grant. A wide range of factors are considered in making compensation decisions, including but not limited to skill sets, market conditions, experience and training, licensure and certifications, and business and organizational needs.

Similar Jobs

6 Days Ago
Hybrid
181K-181K Annually
Senior level
181K-181K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design, build, deploy, and operate cloud-native platform services and Kubernetes workloads from conception through production. Lead technical projects, develop operators and controllers, improve reliability and observability, write tests and automation, participate in on-call, and collaborate with senior engineers on architecture. Mentor junior engineers through reviews, design feedback, and pairing. The role requires strong Go programming, Kubernetes expertise, hyperscaler experience, CI/CD, GitOps, and infrastructure-as-code knowledge.
Top Skills: AWSAzureCi/CdCniContainersDashboardsGCPGitopsGoInfrastructure-As-CodeKubernetesKubernetes ControllersKubernetes OperatorsMetricsMtlsObservabilitySecrets ManagementService MeshTracingWorkload Identity
16 Days Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
198K-341K Annually
Expert/Leader
198K-341K Annually
Expert/Leader
Fintech • Mobile • Software • Financial Services
Provides hands-on technical leadership for enterprise Data Trust platforms. Designs and operates distributed systems supporting data contracts, metadata, lineage, quality, privacy, access controls, reliability, and semantic context for analytics and AI. Leads batch and streaming capabilities across Snowflake, AWS, and Kafka; establishes observability, SLOs, automated enforcement, and operational rigor. Drives cross-functional architecture and multi-quarter initiatives while mentoring engineers and building reusable platform standards.
Top Skills: AbacAmundsenApache IcebergAWSCi/CdDatahubGoJavaKafkaOpenmetadataPythonRbacSnowflakeSQLTerraform
16 Days Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.
Top Skills: Ai TechnologiesApache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account