NVIDIA Logo

NVIDIA

Senior Technical Program Manager, Cloud Infrastructure

Posted 9 Days Ago
Be an Early Applicant
In-Office
Santa Clara, CA, USA
168K-322K Annually
Senior level
In-Office
Santa Clara, CA, USA
168K-322K Annually
Senior level
As a Senior Technical Program Manager, you will lead cloud infrastructure projects, collaborating with teams to optimize AI capacity, manage operations, and ensure adherence to product lifecycles and performance indicators.
The summary above was generated by AI

NVIDIA's deep learning platforms are at the forefront of innovation, profoundly impacting various fields and widely adopted by leading academic institutions, startups, and major Internet companies globally. We're seeking an accomplished and highly skilled Technical Program Manager (TPM) to join our NVIDIA DGX Cloud team. This is an exciting opportunity for a passionate, results-oriented, and creative individual to deliver exceptional value to our DGX Cloud customers. We are specifically looking for a TPM with extensive background in cloud infrastructure bring-up with external partners. You will play a key role in collaborating with CSPs, emerging cloud providers and engineering teams internally to help build AI capacity and infrastructure across the globe

What you'll be doing:

As a DGX Cloud Technical Program Manager, you'll be a key partner to our Engineering, Infrastructure, Software teams and their leadership, driving critical programs related to AI capacity enablement and management. You'll play a pivotal role in developing and maturing foundational capabilities and processes for DGX Cloud, spanning critical areas such as cluster/capacity bring-up including CPU, storage, networking and compute requirements to support GPUs. This is a dynamic, fast-paced environment where TPMs are encouraged to apply fungible abilities to a range of high-impact programs within the DGX Cloud ecosystem.

Your responsibilities will include:

  • Working in close coordination with storage engineering and network engineering teams to define and communicate requirements to CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Providers). Drive alignment and a POR for capacity blocks based on workload needs.

  • Drive early engagement with CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Providers) to understand their managed storage, network solutions and influence alignment with NVIDIA Cloud roadmap

  • Gathering technical requirements, developing comprehensive roadmaps, establishing clear milestones, and ensuring adherence to our Product Lifecycle (PLC) process.

  • Managing ongoing capacity operations and the engineering engagement with CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Provider) partners, collaborating closely with engineering leads. Focus on availability, maintenance and other critical performance indicators.

  • Partner closely within NVIDIA to understand workload requirements and related hardware and infrastructure needs. This includes speeds and feeds to optimize infrastructure readiness with cloud vendors and NVIDIA Cloud Providers.

  • Leveraging Jira and other program management platforms to instill rigor and structure in the management of engineering deliverables.

  • Identifying and driving opportunities to onboard the adoption of third-party and in-house cloud infrastructure solutions for deployments, support, security, compliance and observability across DGX Cloud

  • Establishing key performance indicators (KPIs) and quantitatively demonstrating the value and impact delivered by your programs.

  • Proactively identifying, resolving, and mitigating risks and issues that could affect scope, schedule, and quality across all program aspects.

  • Encouraging a culture of continuous improvement, consistently seeing opportunities for process improvements within our cloud infrastructure operations.

What we need to see:

  • 8+ years of technical program management experience. You have driven the planning and execution of large-scale cloud infrastructure programs with outside organizations. You focus strongly on software engineering projects within a matrixed organization.

  • Extensive hands-on experience in cloud infrastructure, preferably gained from working at a major Cloud Service Provider (CSP).

  • Domain knowledge in the bring-up and end to end operations of compute, storage and GPU (including common failure points at the HW and SW levels).

  • Expert-level proficiency with Jira, Smartsheet, or similar program management tools, with the ability to expertly guide engineering teams on their use of the tools.

  • Outstanding strategic and tactical thinking abilities, coupled with a strong capacity to build consensus and drive program success

  • Comfort and efficiency in growing within ambiguous environments.

  • Possess excellent communication and technical presentation skills, particularly for executive audiences.

  • BS or MS in Electrical Engineering or Computer Science, or equivalent experience.

Ways to stand out from the crowd:

  • In depth knowledge of NVIDIA GPU products, including deployment and bring-up

  • Working knowledge of various cloud technologies (Kubernetes, API integration, Terraform, etc)

  • A highly enthusiastic, energetic, responsive, and passionate individual with a keen eye for identifying process improvement opportunities.

  • Significant experience with productivity tools and process automation is a major plus.

  • Deep familiarity with cloud-native product / services environments and familiarity with AI, ML infrastructure, and cloud/services

NVIDIA is widely considered to be one of the technology world’s most desirable employers! We offer attractive compensation and an extensive benefits package. While planning your future, explore what we provide for you and your loved ones at www.nvidiabenefits.com/ We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until May 5, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

Similar Jobs

2 Days Ago
In-Office
Santa Clara, CA, USA
200K-380K Annually
Senior level
200K-380K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Technical Program Manager will lead cloud infrastructure programs, manage relationships, drive engineering execution, and ensure program success through metrics and communication with executives.
Top Skills: AIAPIsCloud InfrastructureJIRAKubernetesMlSmartsheetTerraform
19 Hours Ago
Hybrid
159K-229K Annually
Mid level
159K-229K Annually
Mid level
eCommerce • Healthtech • Pet • Retail • Pharmaceutical
The Data Scientist III develops machine learning infrastructure, creates algorithms, performs analyses to improve products, and communicates insights to management.
Top Skills: AWSDockerGitKerasPysparkRSnowflakeSparkTableauTensorFlow
19 Hours Ago
Hybrid
120K-190K Annually
Mid level
120K-190K Annually
Mid level
eCommerce • Healthtech • Pet • Retail • Pharmaceutical
As a Software Engineer II, you will design, develop, and maintain software systems for digital advertising, collaborating with cross-functional teams and mentoring junior engineers.
Top Skills: AWSAzureDockerGCPGoJavaKafkaKubernetesNoSQLPythonRabbitMQSQLTypescript

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account