d-Matrix Logo

d-Matrix

Senior Infrastructure Engineer

Posted 19 Days Ago
Remote
Hiring Remotely in USA
98K-150K Annually
Senior level
Remote
Hiring Remotely in USA
98K-150K Annually
Senior level
Owns production infrastructure across Kubernetes, CI/CD, Linux systems, virtual machines, and AI accelerator environments. Responsibilities include incident response, troubleshooting, automation, monitoring, alerting, patching, upgrades, certificate renewals, capacity checks, runbook development, and on-call support. The engineer collaborates across IT and product software teams and contributes to infrastructure design and build work.
The summary above was generated by AI

Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.

Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.

Senior Infrastructure Engineer
Location: Remote, United States

Role Overview

Software Infrastructure runs the Kubernetes clusters, CI/CD systems, and compute environments that every d-Matrix engineer builds and tests on, along with the systems behind our externally accessible product demos. As a senior infrastructure engineer, you will be the team’s first responder and own issues end to end: diagnosing them, fixing them, and engaging IT or the product software group when the root cause sits with them. Our environment combines cloud resources, conventional servers, and our own AI accelerators and networking hardware, so quickly isolating the cause is central to the job. When an issue recurs, you will turn it into automation, better alerting, or a runbook. This is not an IT support or ticket-queue role, and IT owns physical hardware; we manage everything from the operating system up. On-call participation is expected.

What You Will Do

  • Own first response and resolution for issues across Kubernetes clusters, GitLab and CI runners, VMs, standalone systems, and demo environments

  • Triage across teams with IT and the product software group when the root cause sits on their side

  • Convert recurring issues into automation, alerts, and runbooks so repeat incidents decline

  • Improve monitoring and alerting to reduce false alarms and speed detection of real problems

  • Perform routine operational work, including upgrades, patching, certificate renewals, and capacity checks

  • Ship automation and improvements the team relies on, beyond individual fixes

  • Participate in on-call coverage for the environment

  • Contribute to design and build work across the team’s systems as your scope grows

What You Will Bring

  • 2+ years operating production Linux systems, including hands-on Kubernetes troubleshooting

  • Methodical debugging skills: forming hypotheses, narrowing them quickly, and working across layers when the obvious answer is wrong

  • Scripting experience in Python and/or Bash

  • Familiarity with CI/CD systems (GitLab preferred)

  • Working knowledge of networking fundamentals, including DNS, routing, load balancing, and TLS

  • Experience with monitoring and observability tools

  • Clear communication under pressure, including concise incident status updates

  • Drive and curiosity to learn unfamiliar systems and how state-of-the-art inference systems are built

Preferred Qualifications

  • Experience with GPU or accelerator nodes in Kubernetes

  • Experience with infrastructure-as-code tools such as Ansible or Terraform

  • Experience with monitoring platforms such as DataDog, Prometheus, or Grafana

  • Bare metal or on-prem infrastructure experience

  • CKA or CKAD certification

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individuals interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.

HQ

d-Matrix Santa Clara, California, USA Office

5201 Great America Pkwy, Santa Clara, CA, United States, 95054

Similar Jobs

5 Days Ago
Remote or Hybrid
San Francisco, CA, USA
165K-250K Annually
Senior level
165K-250K Annually
Senior level
Cloud • Digital Media • News + Entertainment • On-Demand
Build and operate Philo’s ML and LLM infrastructure, including AWS and Kubernetes platforms, GPU scheduling, model serving, inference optimization, monitoring, evaluation, experimentation, and CI/CD. The role establishes infrastructure best practices, reliability, security, scalability, and Infrastructure as Code while supporting recommendation, video classification, and agent workloads. It also involves collaborating with engineers and vendors to deploy, instrument, and manage production systems.
Top Skills: AirflowAlbAmazon BedrockAnthropicAWSC++CloudFormationCloudwatchDagsterDatadogDnsDockerDvcElasticacheElbElkFeastFluentdGitlabGoGrafanaHTTPIamInfluxdbJavaScriptJenkinsKubeflowKubernetesLakefsLinuxLitellmMetaflowMlflowNlbNvidia TritonOpenaiPgvectorPineconePrometheusPythonRagRayRdsRoute 53RubySqsTcp/IpTectonTensorrt-LlmTerraformTgiTickTypescriptVllmVpcWeaviateWeights & Biases
13 Days Ago
Remote
United States
174K-261K Annually
Senior level
174K-261K Annually
Senior level
Artificial Intelligence • Productivity • Software • Automation
Secure Zapier’s production infrastructure by identifying and mitigating risks, hardening cloud environments, improving Terraform and CI/CD security, managing vulnerability and misconfiguration tools, enforcing least-privilege access, strengthening data governance, hardening Kubernetes images, and supporting incident response. The role collaborates with Platform, Engineering, and Security teams in a remote-first environment.
Top Skills: AWSCi/CdCloudFormationDockerGoInfrastructure-As-CodeJavaScriptKubernetesPythonTerraformWiz
19 Days Ago
Easy Apply
Remote
United States
Easy Apply
150K-185K Annually
Senior level
150K-185K Annually
Senior level
Fintech • Insurance • Machine Learning • Analytics • Financial Services • Automation
Designs and evolves AWS infrastructure as code using CDK, develops backend software primarily in TypeScript, and applies secure engineering practices for regulated environments. The role contributes to architecture, code reviews, CI/CD pipelines, production support, observability, and on-call operations. It collaborates cross-functionally, builds scalable and reusable systems, supports SOC 2 compliance, and uses AI coding assistants to improve development, testing, and documentation.
Top Skills: AWSAws CdkC#Ci/CdClaude CodeCursorGitIamRoute53Security GroupsSoc 2TypescriptVpc

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account