Matter Intelligence Logo

Matter Intelligence

Data/ML Infrastructure Engineer

Reposted 2 Months Ago
In-Office
San Francisco, CA, USA
Mid level
In-Office
San Francisco, CA, USA
Mid level
The Data/ML Infrastructure Engineer builds and operates data infrastructures for processing drone and orbital sensing data, ensuring reliability, observability, and performance while collaborating with research and product teams.
The summary above was generated by AI
About Matter Intelligence

Welcome to Matter, where we are building the future of vision AI: pairing a world-first sensor that sees molecular chemistry, temperature, and 3D shape with a Large World Model that will be the most powerful intelligence engine for the physical world. This system doesn't just see what something looks like; it understands everything from a single pixel. We call this Superintelligent Vision.

Our team has delivered technologies to Mars for NASA/JPL, designed advanced sensors for U.S. Defense, and frontier artificial intelligence systems. We are now building the next generation of space- and airborne-based sensing systems.

About the Role

Matter is hiring a Data Infrastructure Engineer to build the systems that transform drone, airborne, orbital, and mission data into durable, versioned datasets for research and products. Reporting to Ignacio Cases Martin, this individual contributor will work across ingestion, processing, storage, lineage, indexing, and scalable access while partnering closely with AI platform, research, product, and reliability teams.

Key Responsibilities
  • Build reliable ingestion and processing pipelines from sensor and mission systems into curated, versioned, access-controlled datasets.

  • Design batch and streaming workflows that handle partial delivery, duplicate or missing events, schema drift, backfills, corruption, and recovery.

  • Choose and operate storage formats, partitioning strategies, catalogs, indexes, and query interfaces appropriate for high-volume scientific and geospatial data.

  • Maintain lineage across source measurements, transformations, datasets, features, and downstream products so results can be traced and reconstructed.

  • Build data-quality checks, observability, retention controls, and operational tooling that keep datasets trustworthy as volume and complexity grow.

  • Partner with Agent Infrastructure, research, Signal and Evaluation, Product Intelligence, and Telemetry teams on stable data contracts and scalable access patterns.

QualificationsRequired
  • Experience building production data platforms, distributed data pipelines, storage systems, or large-scale backend infrastructure.

  • Strong software engineering skills in Python and experience with databases, schemas, APIs, workflow orchestration, and automated testing.

  • Understanding of data-platform failure modes including partial delivery, duplicates, missing events, schema evolution, stale products, corruption, and resource contention.

  • Experience operating data systems in cloud or containerized environments and diagnosing performance, reliability, and cost issues.

  • Ability to define clear interfaces and communicate tradeoffs across research, product, infrastructure, and operations teams.

Preferred
  • Experience with geospatial, remote-sensing, scientific, image, or other high-dimensional data.

  • Experience with AWS, Kubernetes, Docker, Terraform, workflow systems, Postgres, Redis, object storage, or geospatial and vector indexes.

  • Experience with streaming, large backfills, data catalogs, metadata systems, access controls, and schema evolution.

  • Experience supporting machine-learning training, evaluation, feature, or inference workloads.

What Success Looks Like
  • Sensor and mission data moves into trustworthy datasets through observable, recoverable pipelines.

  • Researchers and products can access versioned data efficiently without losing provenance or scientific context.

  • Data contracts, lineage, tests, and operational tooling reduce silent failures and one-off integration work.

Location

This role is based in San Francisco, CA, and requires onsite work.

ITAR Requirements

To comply with U.S. export regulations, applicants must be one of the following:

  • A U.S. citizen or national

  • A lawful permanent resident (green card holder)

  • Eligible to obtain required authorizations from the U.S. Department of State

Employee Offerings and Benefits

At Matter, we believe in rewarding high performance and providing the support you need to thrive. Our compensation and benefits package includes:

  • Competitive compensation based on experience

  • Early-stage equity package

  • 100% employer-paid health, dental, and vision coverage

  • Opportunity to work on novel sensing, data, and AI systems with real-world deployment paths to the largest industries in the world

Matter Intelligence is an equal opportunity employer. We welcome candidates from all backgrounds who can raise the ambition and performance of the team.

Similar Jobs

One Month Ago
Remote or Hybrid
Sunnyvale, CA, USA
275K-348K Annually
Expert/Leader
275K-348K Annually
Expert/Leader
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Leads an engineering team building scalable ML data infrastructure, including data ingestion, processing, storage, access, pipelines, and analytical platforms. Defines architecture, evaluates technologies, improves performance and reliability, translates data requirements into technical solutions, and ensures governance, security, and regulatory compliance. Provides mentorship, strategic roadmap input, and cross-functional collaboration with ML engineers, data scientists, platform engineers, and product teams.
Top Skills: Agile MethodologyAnalytical PlatformsData EngineeringData InfrastructureData PipelinesJavaMachine LearningPythonScala
20 Days Ago
In-Office
Palo Alto, CA, USA
221K-331K Annually
Junior
221K-331K Annually
Junior
Marketing Tech • Software
Designs and builds high-performance data infrastructure for machine learning model training and feature serving. Responsibilities include developing distributed processing architectures, optimizing training data pipelines, resolving performance bottlenecks, collaborating with ML research teams, and establishing tooling and best practices for ML data infrastructure. The role requires experience with fault-tolerant distributed systems and frameworks such as Apache Spark or Flink.
Top Skills: Apache FlinkSpark
24 Days Ago
In-Office
San Francisco, CA, USA
220K-350K Annually
Expert/Leader
220K-350K Annually
Expert/Leader
Artificial Intelligence • Big Data • Hardware • Machine Learning
Lead the end-to-end data platform for large-scale physical-labor video, from on-device capture and reliable uploads over poor networks through object storage, compression, training-shard creation, dataset versioning, and delivery to research customers. Own petabyte-scale media infrastructure, cost and throughput optimization, observability, and ingestion contracts across firmware and international operations. The role requires strong software engineering and production experience with media or sensor data at significant scale.
Top Skills: AirflowAWSGCPInfrastructure As CodeKubernetesLinuxObject StoragePythonTemporalVideo Codecs

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account