NVIDIA Logo

NVIDIA

Senior Software Engineer - Cluster Networking

Reposted 18 Days Ago
In-Office or Remote
2 Locations
184K-357K Annually
Senior level
In-Office or Remote
2 Locations
184K-357K Annually
Senior level
Own and evolve Kubernetes networking for GPU superclusters spanning multiple clouds and thousands of nodes. Design and operate CNI data planes, overlay meshes, VPNs, gateways, load balancers, and tunnels. Identify scale limitations, build network validation environments, diagnose distributed networking failures, and partner with cloud providers on topology. Provide technical leadership while using strong Linux networking, systems programming, and large-scale debugging expertise.
The summary above was generated by AI

NVIDIA is a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence. Our technology powers everything from generative AI to autonomous systems, and we continue to shape the future of computing through innovation and collaboration. Within this mission, our team, Managed AI Research Superclusters (MARS), builds and scales the infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/ML systems. By joining us, you'll help build solutions that power some of the most sophisticated computing workloads globally.

We are looking for a senior networking engineer to lead the network architecture of our GPU superclusters. Our platform runs frontier model training across tens of thousands of GPUs on multiple clouds, and we are scaling it toward clusters of ten thousand nodes and beyond. At that size, networking stops being a configuration exercise and becomes the hardest engineering problem on the platform — and it is currently one of the areas where we most need depth.

What you'll be doing:

You will be the technical owner of how our clusters communicate internally and externally. This includes the CNI data plane, the overlay mesh, and the nodes connecting clusters across regions and providers.

  • Own and evolve the Kubernetes networking architecture for GPU clusters running at multi-thousand-node scale

  • Design, operate and scale the overlay network - CNI, mesh and VPN topologies (Tailscale, WireGuard), and the gateways that connect control and data planes

  • Design, operate and scale the L7 gateways/load balancers/tunnels (Envoy, Cloudflare)

  • Find and eliminate scale ceilings: packet loss under load, control-plane saturation, IP address management exhaustion, and the failure modes that only appear above a few thousand nodes

  • Build the scale-test environments and validation suites that let us catch networking regressions before they reach production, rather than during a training run

  • Diagnose hard, ambiguous problems across the stack - where a symptom in Slurm or a training job traces back to a mark collision, a stale route, or a saturated tunnel

  • Partner with cloud and neocloud providers on network topology, requirements and capabilities as we bring up new clusters

  • Provide senior technical judgement to a distributed team, and depth in the Custer Networking domain.

What we need to see:

  • BS/MS in Computer Science, Electrical Engineering or a related field, or equivalent experience

  • 6+ years of professional experience in systems, network or infrastructure software engineering

  • Deep command of Kubernetes networking architecture and CNI standards, with production experience operating Calico strongly preferred

  • Proficiency designing and maintaining modern mesh and VPN networking topologies - Tailscale, WireGuard or equivalent

  • Strong Linux networking fundamentals: routing, netfilter and iptables/nftables, packet marking, network namespaces, and how these interact with container runtimes

  • Demonstrated ability to debug distributed network problems at scale - packet capture, tracing, and correlating behaviour across many hosts to find a single root cause

  • Proficiency in Go, Python, C or a comparable systems language

  • Clear written and verbal communication, and the ability to work effectively with engineers across multiple time zones

Ways to stand out from the crowd:

  • Direct experience architecting and operating massive-scale Kubernetes topologies across thousands of concurrent nodes

  • Experience with high-performance fabrics in AI or HPC environments - InfiniBand, RoCE, or RDMA over converged networks

  • Upstream contributions to Calico, Cilium, Tailscale, or Kubernetes networking SIGs

  • Experience operating networking across multiple public clouds and on-premises environments simultaneously

  • Familiarity with Slurm or other HPC schedulers running on Kubernetes

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

An Hour Ago
Remote or Hybrid
USA
146K-272K Annually
Senior level
146K-272K Annually
Senior level
Machine Learning • Payments • Security • Software • Financial Services
Leads and develops an architecture team supporting asset management technology. Defines data, automation, and AI strategies, target architectures, reference patterns, governance, and delivery roadmaps. Evaluates platforms, guides solution design, promotes responsible AI adoption, and partners with business, engineering, risk, cybersecurity, and enterprise architecture stakeholders. Oversees talent development, architecture decisions, modernization, data enablement, automation, and executive communication in a regulated financial-services environment.
Top Skills: Agentic AiAnalytics PlatformsAPIsArtificial IntelligenceCloud ServicesData CatalogsData Governance ToolsData Integration PlatformsEvent StreamingGenerative AiLow-Code PlatformsMachine LearningMiddlewareRetrieval-Augmented GenerationRobotic Process AutomationSoftware Development LifecycleVersion ControlWorkflow Automation
3 Hours Ago
In-Office or Remote
United States
60K-90K Annually
Mid level
60K-90K Annually
Mid level
Big Data • Information Technology • Software • Analytics • Energy
Provides customer-facing technical consulting for AEC and utility customers implementing and optimizing SBS solutions. Leads technical discovery, configures workflows and models, delivers training and workshops, troubleshoots technical issues, documents solutions, manages customer requirements, and partners with Customer Success, Project Management, Product, and Engineering teams.
Top Skills: Autocad ElectricalAutodesk AutocadBimCadCivil 3DInventorRevit
3 Hours Ago
In-Office or Remote
United States
90K-95K Annually
Senior level
90K-95K Annually
Senior level
Big Data • Information Technology • Software • Analytics • Energy
Staff Product Designer will shape product strategy, design systems, and scalable product experiences across multiple teams. Responsibilities include simplifying complex data-heavy workflows, setting design standards, leading critiques, partnering with Product and Engineering, influencing executives, mentoring designers, and building design practices in an evolving organization. The role also involves prototyping with front-end code and experimenting with AI tools to improve design and development workflows.
Top Skills: Ai ToolsCSSHTMLJavaScriptReact

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account