NVIDIA Logo

NVIDIA

Staff Site Reliability Engineer - AI Platform Runtime

Posted 3 Days Ago
Be an Early Applicant
Hybrid
Santa Clara, CA, USA
168K-334K Annually
Expert/Leader
Hybrid
Santa Clara, CA, USA
168K-334K Annually
Expert/Leader
Lead large-scale SRE initiatives, define reliability and platform roadmaps, and build resilient distributed systems for AI-driven products. Design AI agents and skills for platform operations, improve automation and observability, and collaborate across cloud, security, platform, and AI/ML teams. Troubleshoot complex systems, drive incident and postmortem practices, and mentor engineers. The role requires deep expertise in systems architecture, networking, Kubernetes, public cloud, infrastructure as code, and automation.
The summary above was generated by AI

Site Reliability Engineering (SRE) at NVIDIA is an engineering discipline to design, build and maintain large scale production systems with high efficiency and availability using the combination of software and systems engineering practices. This is a highly specialized discipline which demands knowledge across different systems, networking, coding, database, capacity management, continuous delivery and deployment, open source cloud enabling technologies like Kubernetes and Public Cloud. SRE at NVIDIA ensures that our internal and external facing services run maximum reliability and uptime as promised to the users and at the same time enabling developers to make changes to the existing system through careful preparation and planning while keeping an eye on capacity, latency and performance. SRE is also a mindset and a set of engineering approaches to running better production systems and optimizations. Much of our software development focuses on building components to eliminate manual work through automation, performance tuning and growing efficiency of production systems.

As SREs are responsible for the big picture of how our systems relate to each other, we use a breadth of tools and approaches to tackle a broad spectrum of problems. Practices such as limiting time spent on reactive operational work, blameless postmortems and proactive identification of potential outages factor into iterative improvement that is key to both product quality and interesting dynamic day-to-day work. SRE's culture of diversity, intellectual curiosity, problem solving and openness is important to our success. Our organization brings together people with a wide variety of backgrounds, experiences and perspectives. We encourage them to collaborate, think big and take risks in a blame-free environment. We promote self-direction to work on meaningful projects, while we also strive to build an environment that provides the support and mentorship needed to learn and grow.

What you’ll be doing:

  • Lead the technical strategy and roadmap for large-scale, cross-functional SRE initiatives that improve reliability, scalability, and developer productivity across enterprise systems.

  • Design, and build resilient distributed systems that power NVIDIA’s next-generation AI-driven enterprise products and services.

  • Architect and develop AI Agents, AI Skills to accelerate platform operations

  • Drive automation and observability improvements, using metrics and analytics to enhance performance, reliability, and efficiency.

  • Collaborate across Cloud, Platform, Security, and AI/ML teams to implement modern SRE components that ensure high availability and secure operations.

  • Analyze and troubleshoot complex systems, championing best practices in system design, incident management, and postmortem analysis.

  • Mentor and influence engineers across teams, fostering technical excellence and a culture of reliability engineering.

What we need to see:

  • 10+ years of experience in Site Reliability Engineering, Platform Engineering, or Cloud Architect roles.

  • BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience

  • Strong proficiency in programming languages such as Python, Typescript, JavaScript, or Go, with a focus on automation and infrastructure-as-code.

  • Experience with infrastructure-as-code such as AWS CDK, AWS CloudFormation, Terraform or CrossPlane

  • Solid understanding of OpenTelemetry or other Observability implementation at scale.

  • Deep expertise in systems architecture, networking, Kubernetes, and public cloud services (AWS, Azure, or GCP).

  • Outstanding problem-solving, communication, and teamwork skills, with the ability to influence across technical and interpersonal boundaries.

Ways to stand out from the crowd:

  • Passion for and experience with Public Cloud or large-scale automation systems.

  • Demonstrated ability to drive technical strategy and deliver measurable reliability outcomes in complex environments.

  • A strong sense of ownership, curiosity, and innovation, you thrive in ambiguity and turn challenges into opportunities.

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables outstanding creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for exceptional people like you to help us accelerate the next wave of artificial intelligence.

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 270,250 USD for Level 4, and 208,000 USD - 333,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 12, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

7 Minutes Ago
Hybrid
San Francisco, CA, USA
101K-138K Annually
Senior level
101K-138K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Analyze complex data and develop managed data solutions, business intelligence tools, dashboards, metrics, and self-service capabilities. Partner with business and technology teams to deliver strategic insights, manage data quality, metadata, lineage, security, and access governance. The role requires scripting, querying, visualization, Snowflake development, and familiarity with cloud services and data governance.
Top Skills: AWSInformatica DqPythonRSnowflakeSparkSQL
7 Minutes Ago
Remote or Hybrid
San Francisco, CA, USA
245K-335K Annually
Senior level
245K-335K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Leads AI engineering teams responsible for foundational AI infrastructure, including model access, LLM inference, optimization, guardrails, evaluation, governance, observability, and cost management. Oversees development and deployment of scalable AI systems, makes build-versus-buy decisions, establishes technical vision, applies advanced research, and develops high-performing engineering talent.
Top Skills: AWSAws UltraclustersAzureFoundation ModelsGCPHugging FaceLarge Language ModelsModel EvaluationNemo GuardrailsObservabilityPyTorchSimilarity SearchVectordbs
7 Minutes Ago
Hybrid
San Francisco, CA, USA
183K-250K Annually
Senior level
183K-250K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Leads product management for Capital One’s Consumer and Developer Experience organization, driving strategy, innovation, technology-enabled customer experiences, and cross-functional alignment. Oversees platforms supporting digital engagement, developer tools, personalization, AI-driven software development, risk, and supplier capabilities. Applies human-centered, business-focused, technology-driven, integrated problem-solving, and transformational leadership principles to deliver scalable product outcomes.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account