NVIDIA Logo

NVIDIA

Senior Deep Learning Performance Architect - LPU

Reposted 16 Days Ago
Be an Early Applicant
Remote
2 Locations
152K-288K Annually
Senior level
Remote
2 Locations
152K-288K Annually
Senior level
The role involves designing and optimizing GPU architectures for AI Inference, analyzing hardware-software relationships, and developing performance models.
The summary above was generated by AI

We are now looking for a Senior Deep Learning Performance Architect!

NVIDIA seeks a Senior DL Performance Architect to join our group of pioneers who enjoy pushing AI Inference performance boundaries. Our team focuses on ambitious hardware-software co-design to speed AI Inference workloads. This role gives an outstanding opportunity to develop world-class performance strategies, guide future GPU architecture decisions, and lead AI innovation. If you are passionate about AI efficiency Pareto curves, have a proven record of modeling LLM performance and architecting AI systems, and enjoy optimizing every cycle, this role may be perfect for you!

What you'll be doing:

  • Design novel GPU and system architectures to advance the forefront of AI Inference performance and efficiency

  • Construct, investigate, and test popular deep learning algorithms and applications

  • Understand and analyze the relationship between hardware and software architectures as it influences future algorithms and applications

  • Build efficient power and performance models of AI inference stack, while capturing minimal but significant information to guide next-gen HW architecture

  • Collaborate across the company to guide the direction of AI, working with software, research, and product teams

What we need to see:

  • A MS or PhD in a relevant field (CS, EE, Math) or equivalent experience, with 5+ years of relevant experience

  • Strong mathematical foundation in machine learning and deep learning

  • Expert programming skills in C, C++, and/or Python

  • Familiarity with GPU computing (CUDA or similar) and HPC (MPI, OpenMP) stack

  • Strong knowledge and coursework in computer architecture

Ways to stand out from the crowd:

  • Background with systems-level performance modeling, profiling, and analysis

  • Experience in characterizing and modeling system-level performance, accomplishing comparison studies, and documenting and publishing results

  • Background in improving AI Inference workloads by developing CUDA kernels or compilers for custom ASIC hardware

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until June 13, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

Similar Jobs

4 Hours Ago
Remote
United States
200K-250K Annually
Expert/Leader
200K-250K Annually
Expert/Leader
Artificial Intelligence • Blockchain • Professional Services • Security • Consulting • Cybersecurity • Defense
The Principal Security Engineer leads projects, drives technical vision, mentors engineers, engages in business development, and oversees security software development.
Top Skills: C++GoJavaPythonRust
6 Hours Ago
Remote
United States
180K-220K Annually
Mid level
180K-220K Annually
Mid level
Software • Defense
Design and productize AI decision-making systems for a game engine, utilizing HTNs and GOAP to create intelligent behaviors for entities.
Top Skills: Goal-Oriented Action Planning (Goap)Hierarchical Task Networks (Htns)State MachinesVisual Scripting Editor
6 Hours Ago
Easy Apply
Remote
United States
Easy Apply
195K-270K Annually
Senior level
195K-270K Annually
Senior level
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
The Senior Engineering Manager is responsible for developing scalable marketing infrastructure, leading product-oriented teams, and optimizing outreach strategies through data-driven insights and intelligent solutions.
Top Skills: AIData AnalysisMarketing Technology

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account