NVIDIA Logo

NVIDIA

Principal Software Engineer - Networking Hyperscale Engineering

Posted 19 Days Ago
Be an Early Applicant
In-Office
Santa Clara, CA, USA
248K-391K Annually
Expert/Leader
In-Office
Santa Clara, CA, USA
248K-391K Annually
Expert/Leader
The Principal Software Engineer will design high-performance NIC software, enhance AI communication paths, and collaborate with customers in networking systems.
The summary above was generated by AI

NVIDIA is looking for an experienced Principal Software Engineer to expand the US-based Networking Hyperscale Engineering Team. Are you craving an opportunity to work directly with top-tier cloud and AI customers, co-develop software that powers their AI superclusters, and influence NVIDIA’s NIC software roadmap? In this role you will do just that for NVIDIA’s high-performance networking stack spanning Linux kernel, RDMA/RoCE, DPDK, DOCA, NCCL, and NIC firmware.

You will be among the first to design and optimize the NIC and communication paths for our next-generation GPU and NIC platforms and help define their role in the modern AI data center. You’ll work closely with some of the best SDK, driver, firmware, and GPU/NIC architects in the industry, as well as domain experts in large-scale training, collectives, and systems performance.

What you'll be doing:

  • Co-developing NIC software and communication paths with strategic, top-tier customers to enable and scale large AI superclusters.

  • Designing and implementing high‑performance C/C++ components on Linux using DPDK, kernel-bypass techniques, and RDMA/RoCE.

  • Developing and integrating kernel, driver, and NIC firmware features to improve throughput, latency, and reliability for AI workloads.

  • Working closely with NCCL and distributed training teams to tune end-to-end collectives performance over NVIDIA networking at scale.

  • Owning complex performance and functionality debug with customers and representing the team in cross-org architecture discussions.

What we need to see:

  • 15+ years overall experience in a similar or related systems / networking software role.

  • A Bachelor’s, Master’s or PhD in Software Engineering, Computer Science, Computer Engineering, Electrical Engineering, or a related field (or equivalent experience).

  • Deep C/C++ expertise, strong Linux systems knowledge, and hands-on experience with kernel networking / RDMA / NIC drivers or DPDK.

  • Proven experience developing and debugging network operating systems (NOS) and routing/switching protocols used in AI data centers (for example BGP, ECMP, EVPN/VXLAN).

  • Practical experience with DOCA, NIC firmware interfaces, or other hardware-accelerated networking stacks for large-scale systems.

  • Excellent communication skills and a track record of effective collaboration with developers, partners, and customers in dynamic environments.

Ways to stand out from the crowd:

  • Deep knowledge of Linux kernel / systems internals, SoC / SmartNIC / NIC embedded systems, and data center switches and NOS.

  • Hands-on experience with RDMA/RoCE, GPU-related networking (for example GPUDirect RDMA), and high-performance, low-latency data paths.

  • Background optimizing NCCL or other distributed training stacks on large GPU clusters for throughput and tail latency.

  • Experience working with hyperscalers or major cloud providers on strategic, performance-critical AI networking deployments.

  • Contributions to open-source networking, RDMA, DPDK, kernel, CUDA/NCCL, or related ecosystems.

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 248,000 USD - 391,000 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until May 19, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

Similar Jobs

An Hour Ago
In-Office
128K-160K Annually
Senior level
128K-160K Annually
Senior level
eCommerce • Fintech • Payments • Software • Financial Services
The Operational Risk Manager will oversee resilience assurance, crisis management, and operational risk policies, coordinating management reviews and ensuring compliance with regulations while leveraging automation for efficiency.
Top Skills: AIAutomation Tools
2 Hours Ago
Remote or Hybrid
USA
75K-257K Annually
Senior level
75K-257K Annually
Senior level
Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
As a Senior Software Engineer, you will design frontend architectures, collaborate with backend engineers, mentor others, and utilize AI tools for efficient development.
Top Skills: Ci/CdContextGraphQLNext.JsReactReduxRest ApisTypescript
3 Hours Ago
Remote or Hybrid
USA
Senior level
Senior level
Machine Learning • Payments • Security • Software • Financial Services
As a Business Architect Sr, you will provide business architecture guidance, design procedures, consult on best practices, and ensure quality deliverables for complex projects in the Asset Management Group at PNC.
Top Skills: BpmnMachine LearningUml

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account