Boson AI Logo

Boson AI

Site Reliability Engineer, AI/ML Infrastructure

Posted 6 Days Ago
In-Office
Santa Clara, CA
150K-250K Annually
Senior level
In-Office
Santa Clara, CA
150K-250K Annually
Senior level
As a Senior Site Reliability Engineer, you'll manage HPC infrastructure, deploy automation solutions, support ML teams, and troubleshoot storage clusters.
The summary above was generated by AI
About The Role

We're looking for a Senior Site Reliability Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.

You'll be hands-on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You'll also help us plan for future capacity and evaluate new technologies as we continue to scale.

Responsibilities

  • Manage and optimize HPC cluster operations
  • Deploy and maintain infrastructure-as-code solutions
  • Support ML/research teams with cluster usage optimization
  • Operate, troubleshoot and optimize Ceph storage clusters.
  • Develop automation and tooling

Minimum Qualifications

  • 5+ years of experience in SRE or HPC operations.
  • Proficiency in Linux systems administration (Ubuntu/Debian).
  • Experience with Kubernetes and container orchestration
  • Experience with Ceph >1PB deployments and maintenance
  • Knowledge of security best practices in multi-tenant environments.
  • Understanding of L2/L3 networking fundamentals
  • Skilled in Python and Bash scripting.

Preferred Qualifications

  • Experience with infrastructure-as-code tools (Ansible/Terraform).
  • Experience with GitOps (Helm, ArgoCD).
  • Strong grasp of RDMA, InfiniBand, and GPUDirect technologies
  • Familiarity with deep learning frameworks such as PyTorch and TensorFlow.
  • Familiarity in at least one cloud platform: AWS, Azure or GCP.

If you're a natural problem-solver with a passion for continuous learning, we'd love to hear from you.

Top Skills

A100
Ansible
Argocd
Bash
Ceph
Helm
Kubernetes
Linux
Nvidia H100
Python
Terraform

Boson AI Santa Clara, California, USA Office

Santa Clara, CA , United States, 95054

Similar Jobs

2 Hours Ago
In-Office
Long Beach, CA, USA
99K-162K Annually
Mid level
99K-162K Annually
Mid level
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
The Simulation Integration Engineer develops and integrates simulation software and hardware, conducts system tests, and prepares documentation, supporting various airplane programs.
Top Skills: C/C++JavaPython
3 Hours Ago
Remote or Hybrid
Santa Clara, CA, USA
150K-260K Annually
Senior level
150K-260K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
As a Senior Manager of Sales, you'll lead a team, manage forecasts, engage customers, and drive new business acquisition, while coaching and developing sales staff.
Top Skills: It InfrastructureMeddicSaaSSalesforce (Sfdc)Value Selling Methodologies
3 Hours Ago
In-Office
El Segundo, CA, USA
105K-154K Annually
Mid level
105K-154K Annually
Mid level
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
As an Autonomy Engineer, define fault and autonomy requirements, design fault management strategies, and support on-orbit operations for satellite missions.
Top Skills: MatlabPythonSimulinkStk

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account