NVIDIA Logo

NVIDIA

Senior HPC AI Cluster Engineer

Reposted 2 Days Ago
In-Office or Remote
2 Locations
176K-334K Annually
Senior level
In-Office or Remote
2 Locations
176K-334K Annually
Senior level
Designs, deploys, maintains, and tunes large-scale HPC and AI clusters. Responsibilities include workload scheduling, infrastructure automation, CI/CD pipelines, monitoring, logging, alerting, storage and networking deployment, bottom-up troubleshooting, methodology documentation, and R&D support. The engineer works across hardware, operating systems, GPU computing, virtualization, cloud platforms, and software stacks to deliver performant, reliable self-service infrastructure.
The summary above was generated by AI

NVIDIA is looking for an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. we are focused on building supercomputers and AI clusters based on groundbreaking technologies. We are looking for an outstanding engineer, be a key player to the most exciting computing hardware and software to contribute to the latest breakthroughs in artificial intelligence and GPU computing. Provide insights on at-scale system design and tuning mechanisms for large-scale compute runs. You will work with the latest Accelerated computing and Deep Learning software and hardware platforms, and with many scientific researchers, developers, and customers to craft improved workflows and develop new, leading differentiated solutions. You will interact with HPC, OS, GPU compute, and systems specialist to architect, develop and bring up large scale performance platforms.

What you will be doing:

  • Design, implement and maintain large scale HPC/AI clusters with monitoring, logging and alerting

  • Manage Linux job/workload schedules and orchestration tools

  • Develop and maintain continuous integration and delivery pipelines

  • Develop tooling to automate deployment and management of large-scale infrastructure environments, to automate operational monitoring and alerting, and to enable self-service consumption of resources

  • Deploy monitoring solutions for the servers, network and storage

  • Perform troubleshooting bottom up from bare metal, operating system, software stack and application level

  • Being a technical resource, develop, re-define and document standard methodologies to share with internal teams

  • Support Research & Development activities and engage in POCs/POVs for future improvements

What we need to see:

  • A degree in Computer Science, Engineering, or a related field (or equivalent experience) and 8+ years of experience

  • Knowledge of HPC and AI solution technologies from CPU’s and GPU’s to high speed interconnects and supporting software

  • Experience with job scheduling workloads and orchestration tools such as Slurm, K8s

  • Excellent knowledge of Windows and Linux (Redhat/CentOS and Ubuntu) networking (sockets, firewalld, iptables, wireshark, etc.) and internals, ACLs and OS level security protection and common protocols e.g. TCP, DHCP, DNS, etc.

  • Experience with multiple storage solutions such as Lustre, GPFS, Weka.io. Familiarity with newer and emerging storage technologies.

  • Python programming and bash scripting experience.

  • Comfortable with automation and configuration management tools such as Jenkins, Ansible, Puppet/chef

  • Deep knowledge of Networking Protocols like InfiniBand, Ethernet

  • Deep understanding and experience with virtual systems (for example VMware, Hyper-V, KVM, or Citrix)

  • Familiarity with cloud computing platforms (e.g. AWS, Azure, Google Cloud)

Ways to stand out from the crowd:

  • Knowledge of CPU and/or GPU architecture

  • Knowledge of Kubernetes, container related microservice technologies

  • Experience with GPU-focused hardware/software (DGX, Cuda)

  • Experience with RDMA (InfiniBand or RoCE) fabrics

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
176,000 USD – 276,000 USD for Level 4; and 208,000 USD – 333,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

24 Minutes Ago
Remote
United States
140K-170K Annually
Expert/Leader
140K-170K Annually
Expert/Leader
AdTech • Digital Media • Marketing Tech • Analytics
Leads Statara’s Data Products & Engineering department, setting technical direction, managing teams, and overseeing Snowflake-based data infrastructure. Shapes scalable adtech and customer data solutions, supports pre-sales and client discussions, guides architecture and validation, and aligns Product, Data Science, Engineering, and Business Development. The role balances platform reliability, data governance, product roadmaps, commercial opportunities, and the conversion of custom solutions into repeatable data products.
Top Skills: AlteryxAWSSnowflake
Yesterday
Easy Apply
Remote or Hybrid
United States
Easy Apply
100K-166K Annually
Senior level
100K-166K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage enterprise customer implementations of Samsara’s IoT platform, from deployment planning through adoption and value realization. Build launch roadmaps, track implementation and account health, train executives and end users, resolve challenges, and coordinate with Sales, Support, Sales Engineering, Product, and other teams. Mentor Customer Success and Support colleagues while managing multiple customer engagements and strengthening long-term customer relationships.
Top Skills: Enterprise SoftwareIotSaaS
Yesterday
Easy Apply
Remote or Hybrid
United States
Easy Apply
109K-129K Annually
Junior
109K-129K Annually
Junior
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Serve as a technical sales expert for Samsara’s IoT platform, supporting discovery, demonstrations, value assessments, proof-of-concepts, deployment planning, and customer integrations. Explain complex solutions to nontechnical stakeholders, advise installers, write API automation scripts, translate customer feedback to product teams, and support strategic sales cycles. The role is remote in the U.S. West region and requires travel up to 50%.
Top Skills: AIAutomation And Control SystemsBashBusiness Systems IntegrationCan BusCloud InfrastructureCloud SoftwareCloud-Connected HardwareComputer NetworkingComputer VisionElectrical SystemsElectronicsIotJavaScriptOpen ApiPto ApplicationsPython

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account