NVIDIA Logo

NVIDIA

Principal Software Engineer, Cloud Infrastructure

Posted 4 Days Ago
Be an Early Applicant
In-Office
Santa Clara, CA, USA
272K-431K Annually
Expert/Leader
In-Office
Santa Clara, CA, USA
272K-431K Annually
Expert/Leader
Lead architecture and development of large-scale bare-metal and cloud infrastructure across global datacenters. Build and extend OpenStack services, infrastructure-as-code automation, compute control planes, scheduling, provisioning, deployment, upgrade, and rollback systems. Improve platform scalability, availability, performance, and reliability while debugging complex hardware, software, networking, storage, and distributed-system issues. Partner across engineering, SRE, security, and datacenter operations teams.
The summary above was generated by AI

We are seeking a Principal Software Engineer to drive the architecture and development of our bare-metal and cloud compute infrastructure. Our organization supports hundreds of megawatts of datacenter capacity, making a growing physical fleet available as reliable, secure, and efficient compute services for NVIDIA engineering.


We operate an NVIDIA GPU Private cloud that provides infrastructure for continuous integration and validation. Hardware, firmware, drivers, networking, and system software are coordinated and tested on their path to production. The fleet includes x86 and Arm servers, GPUs, DPUs, high-speed networking, storage, and rack-scale systems. Platforms include Grace Blackwell and Vera Rubin. In this senior individual contributor role, you will combine hands-on software engineering with architectural leadership. You will evolve our OpenStack platform, automate infrastructure operations, and address complex systems challenges across multiple datacenters.


What you'll be doing:

  • Own architecture and lead implementation of large-scale OpenStack infrastructure supporting bare-metal provisioning, virtual machines, and engineering workloads spanning several datacenters around the globe.
  • Architect and implement Infrastructure as Code frameworks to automate provisioning, configuration, and lifecycle management across OpenStack and bare-metal environments, using version-controlled definitions, automated validation, drift detection, and safe rollback.
  • Build and improve compute control planes, resource scheduling, topology-aware placement, reservations, and capacity management for heterogeneous hardware.
  • Develop and extend OpenStack services and integrations, including Nova, Neutron, Ironic, Cinder, Keystone, and Placement, based on platform requirements.
  • Improve platform scalability, availability, and performance through architectural changes, profiling, failure analysis, and detailed elimination of operational bottlenecks.
  • Build safe deployment, upgrade, migration, and rollback mechanisms that minimize disruption to engineering workloads.
  • Partner with SRE, datacenter operations, security, product engineering teams to onboard new platforms and resolve failures across system boundaries.

What we need to see:

  • 15+ years of proven experience in software engineering, distributed systems, or cloud infrastructure, demonstrating leadership in diverse technical initiatives across teams. BS or MS in Computer Science, Computer Engineering, or a related field, or equivalent experience.
  • Deep experience crafting, developing, deploying, and fixing production OpenStack environments, particularly Nova, Neutron, and Ironic.
  • Strong software development skills in Python and experience building maintainable services, APIs, and infrastructure automation.
  • Strong understanding of distributed systems, including concurrency, state management, asynchronous workflows, failure handling, and recovery.
  • Deep Linux systems knowledge and experience with virtualization, KVM/QEMU, containers, and guest operating-system provisioning.
  • Proven understanding of cloud networking, including L2/L3 networking, VLANs, overlays, DHCP, PXE boot, routing, and tenant isolation.
  • Experience with databases and messaging infrastructure supporting cloud control planes, such as MySQL/MariaDB and RabbitMQ.
  • Experience operating infrastructure with demanding reliability requirements, including monitoring, incident response, system resources, and production upgrades.
  • Excellent debugging skills across hardware, firmware, operating systems, communication systems, data storage, and distributed services.
  • Ability to translate ambiguous requirements into technical direction and influence engineering teams across organizational boundaries and time zones.

Ways to stand out from the crowd:

  • Contributions to OpenStack or related open-source projects, including upstream features, bug fixes, performance improvements, or architectural proposals.
  • Experience scaling OpenStack across multiple regions or datacenters, including control-plane resilience, fleet upgrades, and workload migration.
  • Expertise in Ironic, Redfish, BMC integration, and provisioning or recovering large bare-metal fleets. Experience with Ceph, distributed storage, and storage integration with OpenStack.
  • Experience with GPU and Arm platforms, PCIe pass-through, SR-IOV, NVLink, InfiniBand, or high-speed Ethernet.
  • A record of delivering architectural improvements that measurably increase reliability, scalability, utilization, or developer efficiency.

NVIDIA brings together engineers working on some of the most ambitious problems in computing. Join us to build the infrastructure that enables the next generation of NVIDIA hardware and software. Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 272,000 USD – 431,250 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 13, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

3 Days Ago
In-Office
Mountain View, CA, USA
143K-304K Annually
Expert/Leader
143K-304K Annually
Expert/Leader
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Architects and operates Azure-scale cloud services for firmware lifecycle management, fleet health, reliability, and infrastructure remediation. Leads AI-driven automation, distributed systems, telemetry, machine learning, deployment orchestration, predictive maintenance, and service healing initiatives across Azure Infrastructure, AI, Hardware, Firmware, and Datacenter organizations. Provides technical leadership, shapes engineering strategy, and delivers mission-critical platform solutions across diverse hardware generations and firmware technologies.
Top Skills: AutomationCC#C++Cloud ServicesDistributed SystemsFirmwareJavaJavaScriptMachine LearningAzurePythonTelemetry
2 Months Ago
In-Office
Menlo Park, CA, USA
264K-380K Annually
Expert/Leader
264K-380K Annually
Expert/Leader
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Database • Analytics
Leads Snowflake’s cloud infrastructure performance strategy by evaluating new AWS, Azure, and GCP hardware, building benchmarking and validation systems, analyzing CPU, memory, and I/O bottlenecks, and developing price-performance models. Partners with engineering, finance, cloud providers, and silicon vendors to guide hardware adoption and rollout decisions. Establishes performance architecture and methodology, automates scorecards and readiness workflows, mentors engineers, and advances company-wide performance engineering practices.
Top Skills: Amd TurinAWSAzureAzure Arm/CobaltCpu MicroarchitectureGCPGcp AxionGravitonHardware EmulationPerformance BenchmarkingPmu CountersTpc-Ds
15 Minutes Ago
In-Office
San Jose, CA, USA
Entry level
Entry level
Events • Food • Travel • Hospitality • Hotels & Resorts
Manage event planning and on-property execution, serving as the primary client contact, resolving issues, identifying upsell opportunities, coordinating event transitions, guiding team performance, supporting site visits, and ensuring exceptional guest and client experiences.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account