X, The Moonshot Factory Logo

X, The Moonshot Factory

Senior Machine Learning Data Engineer (DataOps), Materra

Reposted 2 Months Ago
In-Office
Mountain View, CA, USA
166K-244K Annually
Mid level
In-Office
Mountain View, CA, USA
166K-244K Annually
Mid level
Build and consolidate data infrastructure for ML training: design automated ETL/ELT pipelines, implement DataOps practices (validation, monitoring, anomaly detection), integrate annotation workflows, manage dataset versioning and storage, and collaborate with ML engineers and operations to produce high-quality, reproducible training datasets.
The summary above was generated by AI

About the team:

Materra is on a mission to radically reduce global waste and move to a true circular economy. The team has developed technology that identifies waste material at the molecular level—starting with plastics. Materra works with industry partners to improve the way recycling centers process plastics using AI and robotics, to make recycling more affordable and scalable.
About the Role
We are looking for a Senior Machine Learning Data Engineer (DataOps) to build and unify the data infrastructure that powers our model training pipelines. In this role, you will lead the effort to consolidate fragmented data sources into a cohesive, high-quality data foundation.
Your primary focus will be designing automated ingestion pipelines, establishing data quality validation frameworks, and managing dataset versioning to support our machine learning training loops. You will bridge the gap between operations, remote annotation teams, and machine learning engineers to ensure our models are trained on reliable, well-structured data.
Key Responsibilities

  • Architect and build automated ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) data pipelines to aggregate, clean, and harmonize data from disparate sources, databases, and operational ingestion flows.
  • Implement DataOps practices, including data quality monitoring, automated schema validation, and anomaly detection to catch corrupt or mislabeled data early.
  • Standardize and integrate third-party annotation workflows and remote labeling feeds into unified datasets ready for model training.
  • Design and maintain dataset versioning and storage systems to allow reproducible machine learning experiments and seamless data retrieval.
  • Collaborate with machine learning engineers and operations teams to translate raw material, form factor, and sensor metadata into structured training features.

Requirements

  • Education: Degree in Computer Science, Data Engineering, Software Engineering, or a related technical field.
  • Data Engineering & Architecture: 5+ years  experience building scalable data pipelines, managing relational and non-relational databases, and unifying fragmented data storage systems.
  • Modern Python Proficiency: Expertise in Python and data manipulation libraries (e.g., Pandas, NumPy, or SQL).
  • Data Quality & DataOps: Practical experience implementing automated data validation, quality control frameworks, and dataset versioning practices.
  • ML Data Lifecycle Understanding: Hands-on experience structuring datasets specifically for machine learning workflows, including handling annotations, metadata tracking, and training set curation.

Preferred Skills

  • Google Cloud Ecosystem: Hands-on experience with Google Cloud platform tools (e.g., BigQuery, Cloud Storage, Dataflow, Dataproc, Vertex AI Data Pipelines).
  • Workflow Orchestration: Experience managing pipelines using Google Cloud Composer or equivalent orchestration frameworks (e.g., Apache Airflow, Prefect, Dagster).
  • Multimodal / Unstructured Data: Experience handling mixed data types, including image datasets, sensor metadata, and unstructured physical property records.
  • Annotation Platform Integration: Familiarity with data labeling platforms, human-in-the-loop workflows, or integrating third-party annotation APIs.
  • Validation & Versioning Tooling: Exposure to data quality and ML versioning tools (e.g., Great Expectations, DVC, or TFX/Data Validation).

The US base salary range for this full-time position is $164,000 - $261,000 + bonus + equity + benefits. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your location during the hiring process.
Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits.

HQ

X, The Moonshot Factory Mountain View, California, USA Office

1600 Amphitheatre Pkwy, Mountain View, CA , United States, 94043

Similar Jobs

An Hour Ago
Remote or Hybrid
United States
66K-89K Annually
Junior
66K-89K Annually
Junior
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Provides Oracle NetSuite optimization consulting for clients, including requirements analysis, discovery sessions, solution recommendations, configuration support, user acceptance testing, documentation, and client working sessions. Tracks project work, budgets, and deliverables; communicates status and issues; mentors junior consultants; and supports research, sales, marketing, and cross-selling initiatives.
Top Skills: ExcelMicrosoft OutlookMicrosoft PowerpointMicrosoft VisioMicrosoft WordOracle Netsuite
An Hour Ago
Remote or Hybrid
United States
80K-108K Annually
Senior level
80K-108K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Leads full-cycle iSolved HCM and payroll implementations, including requirements discovery, configuration, data validation, testing, training, go-live, and post-implementation transition. Manages multiple customer projects, timelines, resources, risks, and deliverables while recommending solutions and coordinating internal teams. Mentors junior consultants, reviews implementation work, and improves implementation processes. Requires knowledge of payroll, time and attendance, benefits, HR administration, and software implementation in a client-facing consulting environment.
Top Skills: HcmHrisIsolvedSaaS
An Hour Ago
Hybrid
165K-185K Annually
Senior level
165K-185K Annually
Senior level
AdTech • Big Data • Digital Media • Marketing Tech
Build and scale Java backend services, recommendation infrastructure, and data-processing pipelines for Taboola’s performance advertising platform. Design reliable microservices, search and event-driven systems handling billions of events and terabytes of data. Own services end to end, including production monitoring, incident response, root-cause analysis, and continuous improvement. Collaborate with product and architecture teams, manage integration projects, mentor engineers, and use AI-assisted development tools.
Top Skills: SparkCassandraClaudeCodexCursorDockerElasticsearchGitGoogle BigqueryHadoopJavaKafkaKubernetesMicroservicesMySQLPythonRestful ApisSolrSpring FrameworkVespa

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account