NVIDIA Logo

NVIDIA

Senior Software Developer, AI Networking

Posted 11 Days Ago
In-Office or Remote
5 Locations
152K-288K Annually
Senior level
In-Office or Remote
5 Locations
152K-288K Annually
Senior level
Develop and maintain AI networking communication frameworks, production benchmarking tools, and automation for large-scale AI training/inference. Enable models in benchmarking infrastructure, analyze end-to-end performance, perform large-scale parameter searches, and collaborate with networking and hardware teams to co-design features and optimize system performance.
The summary above was generated by AI

NVIDIA is changing the world of AI Networking with groundbreaking technology. We are excited to be adding an AI Networking Software Developer to our AI Networking SW development and codesign team. We are working with the latest NVIDIA hardware and technologies. We do full stack benchmarking for Data Center scale systems for AI training/inference and lower level benchmarks. We strive for automation and develop many tools in-house yet adopt community accepted practices and frameworks. Moreover we give back to community developing our own tools in public GitHub repositories. Our goal is to ensure that large-scale systems deliver expected performance in practice, not just on paper, by uncovering bottlenecks and driving continuous improvements.

What you'll be doing:

  • Developing AI networking communication frameworks and applications running in production on the world’s largest supercomputers and data centers.

  • Develop production tools and benchmarks used by multiple teams inside and outside NVIDIA.

  • Enable new AI models within our benchmarking infrastructure and deliver insights through end-to-end analysis of large-scale workloads across hardware and software stacks.

  • Design and implement automation systems, including large-scale parameter search to identify optimal configurations across complex systems.

  • Collaborate closely with networking and hardware teams to co-design new features and software interfaces in a fast-paced, evolving environment.

What we need to see:

  • B.Sc., M.Sc degree in Computer Science / Software engineering or equivalent experience.

  • 5+ years of experience.

  • Professional Python development experience. We seek individuals who build maintainable, long-lived tools that do not impose a heavy burden on the team in terms of maintenance.

  • Solid Linux expertise and passion for working extensively in command-line environments.

  • Ability to work across a broad and evolving stack, with a strong drive to learn—from hardware and networking up to large-scale AI systems running across entire clusters

Ways to stand out from the crowd:

  • Knowledge and/or experience with modern AI ecosystem: PyTorch, LLMs, inference and training.

  • Familiarity with cluster orchestration systems such as Slurm or Kubernetes.

  • Knowledge in MPI and HPC, InfiniBand, Ethernet and Networking.

  • Experience in performance optimizations

For two decades, we have pioneered visual computing, and the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, product design, medical diagnosis and scientific research. Today, we stand at the beginning of the next era, the AI computing era, ignited by a new computing model, GPU deep learning. This new model - where deep neural networks are trained to recognize patterns from massive amounts of data - has shown to be deeply effective at solving some of the most complex problems in everyday life. NVIDIA is widely considered to be one of the technology world's most desirable companies to work for. Are you creative and driven? Do you love a challenge? If so, we want to hear from you.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 19, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

An Hour Ago
Remote or Hybrid
44K-85K Annually
Junior
44K-85K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound and warm sales leads to consult customers on Property & Casualty insurance, match products to needs, close policies, and complete required licensing. Participate in paid remote training, follow work-at-home standards, work set shifts including weekends, and meet performance and sales targets.
An Hour Ago
Easy Apply
Remote
United States
Easy Apply
280K-340K Annually
Expert/Leader
280K-340K Annually
Expert/Leader
Healthtech • Software
Lead and scale AI platform and agent engineering teams to build AI infrastructure, agent runtimes, MLOps/LLMOps, prompt and skills lifecycle management, and forward-deployed engineering for healthcare customers. Drive platform reliability, security, observability, enterprise integrations, and operational excellence to deploy AI-powered solutions at scale.
Top Skills: Agent PlatformsAgent Runtime SystemsAi InfrastructureAi Observability And MonitoringAWSCloud-NativeDocument ProcessingKnowledge Ingestion PipelinesLlmopsMlopsPrompt Lifecycle Management
An Hour Ago
Remote or Hybrid
5 Locations
123K-123K Annually
Expert/Leader
123K-123K Annually
Expert/Leader
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead and oversee multiple multidisciplinary teams to architect, develop, deploy, monitor, and maintain full-stack AI solutions (including LLM integrations). Provide strategic and technical leadership, drive experimentation and CI/CD practices, ensure quality and stakeholder alignment, promote innovation, and mentor senior and junior team members to deliver business-aligned AI outcomes.
Top Skills: AWSAzureCi/CdGitGoogle Cloud PlatformLangchainLlmsPandasPrompt EngineeringPythonPyTorchScikit-LearnSemantic KernelSQLVector Dbs

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account