NVIDIA Logo

NVIDIA

Manager, Software Engineering

Posted 5 Hours Ago
Be an Early Applicant
In-Office or Remote
2 Locations
224K-431K Annually
Expert/Leader
In-Office or Remote
2 Locations
224K-431K Annually
Expert/Leader
Leads an engineering team building NVIDIA’s large-scale AI infrastructure platform. Owns roadmap, architecture, reliability, on-call health, Kubernetes-based systems, scheduling, data movement, and fleet-scale automation. Partners with research, infrastructure, cloud, storage, networking, vendors, and open-source communities to turn AI training needs into reliable platform capabilities. Hires and develops senior engineers, drives technical decisions, and improves service reliability through observability, incident response, and postmortems.
The summary above was generated by AI

NVIDIA is a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence. Our technology powers everything from generative AI to autonomous systems, and we continue to shape the future of computing through innovation and collaboration. Within this mission, our team, Managed AI Research Superclusters (MARS), builds and scales the infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/ML systems. By joining us, you'll help build solutions that power some of the most sophisticated computing workloads globally.


We build and run the platform that NVIDIA's own researchers use to train frontier models. That means some of the largest GPU clusters in the world, spread across multiple clouds and partners, used for pre-training, post-training and reinforcement learning. Our engineers own how work gets scheduled onto that fleet, how data and checkpoints move through it, and the Kubernetes-based platform underneath. We are looking for an engineering manager to lead one of these engineering teams. You will grow a team of strong engineers, own a platform area end to end, and work directly with research teams whose results depend on it. You will shape what the platform becomes, not only keep it running.


What you'll be doing:

  • Lead, hire and grow a team of software and systems engineers, including senior and staff-level engineers and tech leads.
  • Lead a core part of the AI infrastructure platform end to end: its roadmap, architecture, reliability and on-call health.
  • Turn research needs into platform capabilities by working directly with model training teams.
  • Set clear ownership and decision rights for your area: named owners, written decisions, and clean interfaces to partner teams.
  • Drive engineering quality at fleet scale: automation over manual operations, observability built in, safe rollouts across many clusters.
  • Partner with infrastructure, storage, networking, Kubernetes and cloud-provider teams across NVIDIA, and with external vendors and open-source communities.
  • Measure what matters for researchers, such as reliability, latency, and use it to set priorities.
  • Contribute to the shared Kubernetes-based platform codebase, including its open-source path, alongside your own team's systems.

What we need to see:

  • BS or MS in Computer Science, Computer Engineering or a related field, or equivalent experience.
  • 12+ overall years in software engineering, with 5+ years managing engineering teams, including leading tech leads or managers.
  • A track record of building and running large-scale distributed systems in production: clusters, platforms or infrastructure services used by other engineers.
  • Hands-on depth in at least one of: workload scheduling and resource management, distributed storage and data systems, or Kubernetes-based platforms.
  • Hiring and growing senior engineers, and building teams that keep quality high under pressure.
  • Experience owning reliability for critical services: on-call, incident response, postmortems and the fixes that follow.
  • Clear written communication. You can take a contested technical question across several teams to a decision, and write it down.

Ways to stand out from the crowd:

  • Experience with GPU clusters for AI training at scale: thousands of GPUs, large training runs, high-speed interconnects.
  • Experience with reinforcement learning or post-training workloads and what they need from infrastructure.
  • Contributions to open-source infrastructure projects, or experience taking an internal platform open source.
  • Has led teams across time zones.
  • Uses AI coding and operations tools in daily work and has raised a team's productivity with them.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
224,000 USD – 356,500 USD for Level 3; and 272,000 USD – 431,250 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 8, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

Senior level
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Lead the POS Payments Experience engineering team, delivering reliable Android and web-based payment products. Drive planning, cross-team execution, technical direction, architecture, quality, monitoring, and production issue resolution. Partner with product and UX leaders, hire and develop engineers, and champion AI-assisted development practices.
Top Skills: AndroidJavaKotlin
5 Days Ago
Remote
US
193K-309K Annually
Entry level
193K-309K Annually
Entry level
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Leads an engineering team delivering Quoting, Catalog Management, and go-to-market technology. Oversees technical decisions, delivery planning, code reviews, quality assurance, release planning, incident resolution, stakeholder collaboration, and team development. Partners with Sales, Product, RevOps, and Data Analytics leaders while driving scalable solutions across Salesforce CPQ, Product Catalog, and related systems. Champions AI-assisted development and contributes to complex architecture and implementation efforts.
Top Skills: Ai Development ToolsCi/CdETLGitPricing RulesProduct CatalogRestSalesforceSalesforce CpqSoap
8 Days Ago
Easy Apply
Remote
United States
Easy Apply
204K-290K Annually
Entry level
204K-290K Annually
Entry level
Big Data • Fintech • Mobile • Payments • Financial Services
Leads Affirm’s Resilience Engineering team, defining strategy and building platforms for safe production load testing and chaos engineering. Responsibilities include developing fault-injection and experimentation systems, implementing isolation and rollback safeguards, improving observability and auditability, driving reliability initiatives, and partnering across engineering, infrastructure, product, and security teams. The manager mentors engineers, establishes resilience practices, and enables organization-wide adoption of proactive system validation.
Top Skills: AWSGremlinHarnessJavaKotlinKubernetesPython

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account