NVIDIA Logo

NVIDIA

Senior Technical Program Manager, DGX Cloud Software Products and Services

Posted 7 Days Ago
Be an Early Applicant
In-Office
Santa Clara, CA, USA
Senior level
In-Office
Santa Clara, CA, USA
Senior level
Lead daily operations for NVIDIA’s Exemplar Performance Program across cloud service providers, NVIDIA Cloud Partners, and engineering teams. Coordinate GPU capacity, benchmarking, debugging, QA, releases, validation, and roadmap execution across training, inference, Kubernetes, and agentic AI workloads. Establish operating rhythms, metrics, playbooks, and release evidence while resolving cross-functional technical dependencies and communicating program health to senior leadership.
The summary above was generated by AI

NVIDIA’s DGX Cloud (DGXC) supports AI for key research and product tasks. The Exemplar Performance Program is central to this goal. It guides all CSP and NCP partners toward achieving outstanding performance and shifts the focus from GPU cost per hour to total workload cost of ownership. Exemplar provides a clear, consistent measure of what NVIDIA hardware and software achieve at scale. It sets the benchmark for cloud partners and challenges inaccurate GPU comparisons made by analysts.


We seek a Senior Technical Program Manager to handle daily operations for the Exemplar Performance Program. You will convert priorities into synchronized capacity, validation, debugging, and release plans across CSPs, NVIDIA Cloud Partners (NCPs), and internal engineering groups. Your role includes managing workstreams that cover Slurm and Kubernetes-based training and inference benchmarking, cross-partner debugging, release and QA coordination, PLC/OSRB alignment, and program visibility simultaneously. As the program expands into inference and agentic AI workloads, you will apply these methods to new stack complexities and partner engagements. You will collaborate directly with the program and Product lead to ensure execution aligns with Roadmaps. This position demands solid technical expertise, initiative, and the capability to work well with engineering, product, and partner-facing groups at different levels of the company. The ideal applicant has a deep understanding of cloud infrastructure and inference systems. They can ask insightful questions, lead investigations to resolution, and turn technical obstacles into concise action steps!


What You’ll Be Doing:

  • Maintain the demand and allocation levels across platforms, GPU counts, topologies, and workloads; coordinate capacity reservations, access, readiness checks, and debug windows with cluster owners.
  • Track cross-CSP performance investigations with engineering, SAs, and partner teams and build playbooks and pre-flight checks for repeat offenders.
  • Maintain a coordinated achievement and coverage plan across recipes, frameworks, results tooling, and QA; follow up on MR reviews, merges, dependencies, and blocking regressions, and prepare release readiness summaries for each program increment.
  • Help connect software roadmap execution to full-stack readiness, including dependencies across infrastructure, bring-up, validation, and downstream operational support.
  • Standardize intake, debug handoffs, and release evidence practices; extend them from training into inference, K8s, and agentic benchmarking as priorities evolve.
  • Establish engineering and product rhythm for Product Life Cycle (PLC) achievements and monthly release cadences.
  • Identify multi-functional dependencies, mitigate risks, and drive resolution of complex technical and programmatic issues across partner, engineering, and product teams.
  • Develop and maintain metrics for program efficiency and delivery health; collect and analyze data to support planning and data-driven decisions, and communicate progress clearly to senior leadership.

What We Need to See:

  • 8+ years of technical program management experience. A Bachelor’s degree or equivalent experience to this in Computer Science, Electrical Engineering, AI, or a related field is required. You must have demonstrated ability to manage programs across multiple time zones and organizations.
  • Practical knowledge of inference systems, cloud platforms, and distributed computing — sufficient to pose relevant technical questions and interpret engineering updates directly.
  • Track record managing complex, multi-stakeholder programs in fast-paced software development environments, from kickoff through partner-facing delivery.
  • Background in software release management, QA coordination, and platform validation cycles — preferably including compliance or review routines like open-source review, security review, or PLC/OSRB.
  • Strong written communication skills; ability to write crisp, executive-ready program status updates and blocking issue memos that lead with signal, not noise.
  • Experience with large-scale Agile tools and reporting (Jira, NVBugs, or equivalent) and comfort defining your own tracking structure when one doesn’t exist.

Ways to Stand Out from the Crowd:

  • Strong background in Machine Learning, Deep Learning, and Artificial Intelligence applications, with familiarity with AI benchmarking tools, evaluation frameworks, or performance scorecards for large-scale GPU workloads!
  • Experience working with LLM inference frameworks like vLLM, SGLang, or TensorRT-LLM, or knowledge of inference optimization methods such as speculative decoding, quantization, disaggregated prefill/decode, or multi-token prediction.
  • Prior experience supporting CSP or NCP partner programs, including coordinating platform validations, cluster capacity requests, or performance bring-up across organizational boundaries.
  • Kubernetes or cloud-native workload experience, with an understanding of how container orchestration affects GPU placement, scheduling, and workload repeatability.
  • Experience with open-source software release procedures, including contributor licensing, OSRB-style assessments, and ecosystem readiness, to bring internal tooling public in a compliant, organized way.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
168,000 USD – 258,750 USD for Level 4; and 200,000 USD – 322,000 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 7, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

10 Minutes Ago
Hybrid
15-24 Hourly
Junior
15-24 Hourly
Junior
eCommerce • Fashion • Retail • Sales • Wearables • Design
Serve as a Coach brand ambassador by delivering personalized luxury retail experiences, building client relationships, meeting sales goals, and driving revenue through styling, cross-selling, upselling, and clienteling. Operate POS and mobile selling tools, process transactions, support inventory and visual merchandising, maintain sales-floor standards, and collaborate with teammates. Work a flexible schedule, including nights, weekends, holidays, and peak seasons, while handling physical stockroom and sales-floor duties.
Top Skills: IpadLaptopMobile PosPosShort-Form VideoSocial Selling PlatformsWalkie-Talkie
10 Minutes Ago
Hybrid
15-24 Hourly
Junior
15-24 Hourly
Junior
eCommerce • Fashion • Retail • Sales • Wearables • Design
Provides personalized luxury retail service, builds client relationships, drives individual and store sales, and supports daily store operations. Responsibilities include styling customers, cross-selling, using mobile POS and clienteling tools, processing transactions, managing inventory, replenishing merchandise, maintaining visual standards, and supporting team performance. Requires flexible availability, strong communication, basic computer and POS skills, and the ability to lift up to 50 pounds occasionally.
Top Skills: Clienteling ToolsIpadMobile PosPosShort-Form VideoSocial Selling PlatformsWalkie-Talkie
10 Minutes Ago
Hybrid
15-22 Hourly
Junior
15-22 Hourly
Junior
eCommerce • Fashion • Retail • Sales • Wearables • Design
Provides customer service and sales support in a luxury retail store. Responsibilities include welcoming clients, operating POS and cash wrap, promoting products and gift cards, processing shipments, organizing stock, replenishing merchandise, executing visual merchandising updates, supporting sales-floor activities, and following loss-prevention and housekeeping standards. Requires flexible scheduling, physical stockroom and sales-floor work, strong communication, retail experience, and basic computer and mobile POS proficiency.
Top Skills: Cash Register SystemsInternetIpadLaptopMobile PosPosWalkie-Talkie

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account