NVIDIA Logo

NVIDIA

Senior Technical Program Manager, Cloud Infrastructure

Reposted 4 Days Ago
Be an Early Applicant
In-Office
Santa Clara, CA, USA
168K-322K Annually
Senior level
In-Office
Santa Clara, CA, USA
168K-322K Annually
Senior level
Lead large-scale cloud infrastructure programs for NVIDIA DGX Cloud, partnering with cloud service providers and internal engineering teams to bring up global AI capacity. Define technical requirements, roadmaps, milestones, KPIs, and operational processes across compute, storage, networking, and GPU infrastructure. Manage capacity operations, risks, partner alignment, infrastructure deployments, compliance, security, and observability while driving continuous improvement and executive communication.
The summary above was generated by AI

NVIDIA's deep learning platforms are at the forefront of innovation, profoundly impacting various fields and widely adopted by leading academic institutions, startups, and major Internet companies globally. We're seeking an accomplished and highly skilled Technical Program Manager (TPM) to join our NVIDIA DGX Cloud team. This is an exciting opportunity for a passionate, results-oriented, and creative individual to deliver exceptional value to our DGX Cloud customers.


We are specifically looking for a TPM with extensive experience in cloud infrastructure  bring-up with external partners. You'll be instrumental in partnering with CSPs, emerging cloud providers and engineering teams internally to help build AI capacity and infrastructure across the globe 

What you'll be doing:

As a DGX Cloud Technical Program Manager, you'll be a key partner to our Engineering, Infrastructure, Software teams and their leadership, driving critical programs related to AI capacity enablement and management. You'll play a pivotal role in developing and maturing foundational capabilities and processes for DGX Cloud, spanning critical areas such as cluster/capacity bring-up including CPU, storage, networking and compute requirements to support GPUs.  This is a dynamic, fast-paced environment where TPMs are expected to apply fungible skillsets to a range of high-impact programs across DGX Cloud.

  • Collaborate with storage and network engineering teams to define and communicate workload requirements — including speeds, feeds, and infrastructure readiness — to CSPs and NCPs, driving alignment on a plan of record (POR) for capacity blocks.
  • Drive early engagement with CSPs and NCPs to understand their managed storage and network solutions and influence alignment with the NVIDIA Cloud roadmap.
  • Gather technical requirements, develop comprehensive roadmaps, establish clear milestones, and ensure adherence to the Product Lifecycle (PLC) process.
  • Manage ongoing capacity operations and engineering engagement with CSP and NCP partners, collaborating with engineering leads on availability, maintenance, and critical performance indicators.
  • Leverage Jira and other program management platforms to instill rigor and structure in the management of engineering deliverables.
  • Identify and drive opportunities to onboard third-party and in-house cloud infrastructure solutions across deployments, support, security, compliance, and observability for DGX Cloud.
  • Establish KPIs to quantitatively demonstrate program value and impact while proactively identifying, resolving, and mitigating risks affecting scope, schedule, and quality.
  • Cultivate a culture of continuous improvement, consistently identifying opportunities for process enhancements within cloud infrastructure operations..

What we need to see:

  • 8+ years of technical program management experience, specifically driving the planning and execution of large-scale cloud infrastructure programs with external partners, with a strong focus on software engineering projects within a matrixed organization.
  • Extensive hands-on experience in cloud infrastructure, preferably gained from working at a major Cloud Service Provider (CSP).
  • Domain knowledge in the bring-up and end to end operations of compute, storage and GPU (including common failure points at the HW and SW levels).
  • Expert-level proficiency with Jira, Smartsheet, or similar program management tools, with the ability to confidently guide engineering teams on their use of the tools.
  • Exceptional strategic and tactical thinking abilities, coupled with a strong capacity to build consensus and drive program success
  • Comfort and effectiveness in thriving within ambiguous environments.
  • Possess excellent communication and technical presentation skills, particularly for executive audiences.
  • BS or MS in Electrical Engineering or Computer Science, or equivalent experience.

Ways to stand out from the crowd:

  • In-depth knowledge of NVIDIA GPU products, including deployment and bring-up, combined with deep familiarity with cloud-native product and services environments.
  • Working knowledge of cloud technologies including Kubernetes, API integration, Terraform, and related tooling.
  • Familiarity with AI and ML infrastructure, with an understanding of how NVIDIA’s deep learning platforms are applied across academic, startup, and enterprise environments.
  • Significant experience with productivity tools and process automation, with a keen eye for identifying and driving process improvement opportunities.
  • A highly enthusiastic, energetic, responsive, and passionate individual who thrives in fast-paced environments and is driven to deliver meaningful value to DGX Cloud customers.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
168,000 USD – 258,750 USD for Level 4; and 200,000 USD – 322,000 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

Yesterday
In-Office
Santa Clara, CA, USA
Senior level
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Lead cloud infrastructure programs for NVIDIA DGX Cloud, coordinating CSP/NCP partners and internal engineering teams. Manage data center and server fleet bring-up, hardware validation, automation, capacity operations, software integration, roadmaps, risks, governance, metrics, and operational workflows. Drive deployment readiness from rack-and-stack through customer-ready clusters while improving infrastructure availability, resiliency, security, and performance.
Top Skills: AgileBare-Metal InfrastructureCloud-Native ArchitecturesDistributed SystemsDsxHpc InfrastructureJIRAKubernetesNvidia Dgx CloudNvidia GpuScrumSmartsheetVirtual Machines
4 Days Ago
In-Office
Santa Clara, CA, USA
200K-322K Annually
Senior level
200K-322K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Leads complex technical programs for DGX Cloud infrastructure operations, service health, reliability, operational readiness, and platform availability. Coordinates engineering, operations, and reliability teams; manages plans, dependencies, risks, metrics, issue reviews, and maintenance readiness. Translates telemetry and incident trends into prioritized actions and communicates progress, tradeoffs, and recommendations to technical and executive stakeholders.
Top Skills: Accelerated ComputingAi InfrastructureCloud InfrastructureDistributed SystemsHigh-Performance ComputingObservability
22 Days Ago
In-Office
146K-197K Annually
Senior level
146K-197K Annually
Senior level
Fintech • Real Estate • PropTech
Lead security, compliance, and infrastructure reliability programs across engineering. Own quarterly planning, roadmaps, and cross-team execution; identify risks, remove blockers, measure outcomes, and report program status to senior leadership.
Top Skills: AWSCloud GovernanceDatabasesKubernetesNetworkingStreaming

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account