xAI Logo

xAI

Sr. Software Engineer, Kernels/CUDA (C++)

Posted Yesterday
Be an Early Applicant
In-Office
Palo Alto, CA, USA
220K-357K Annually
Senior level
In-Office
Palo Alto, CA, USA
220K-357K Annually
Senior level
Develop and optimize large-scale GPU supercomputing infrastructure for AI training and inference. Build low-level CUDA kernels using CUTLASS, Tensor Cores, and Nsight; profile and resolve performance bottlenecks across GPU memory, networking, filesystems, and multi-GPU systems; and collaborate with AI researchers to deliver scalable, production-grade compute performance.
The summary above was generated by AI

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.
SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.

SR. SOFTWARE ENGINEER, KERNELS/CUDA (C++)

We are building one of the world’s largest AI supercomputers from the ground up. As part of the Compute Infrastructure team, you will own both the raw GPU supercomputer and the platform layer that runs on top of it. You will work across the full stack — from low-level GPU kernel optimizations and Linux kernel internals to massive-scale orchestration and virtualization — to make training and inference at SpaceXSI as fast, reliable, and scalable as possible.
This is a broad, high-impact role that combines hardcore supercompute and compute infrastructure work. Your contributions will directly accelerate Grok’s training speed and overall AI progress.

RESPONSIBILITIES:
  • Design, build, and optimize massive GPU clusters for extreme-scale training and inference workloads
  • Develop and tune low-level CUDA kernels (GeMM, Attention, etc.), using CUTLASS, Tensor Cores, and Nsight for maximum performance
  • Profile, debug, and eliminate bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operation
  • Collaborate closely with AI research teams to deliver production-grade performance and scalability
BASIC QUALIFICATIONS:
  • 5+ years of experience with low-level system programming in C/C++
PREFERRED SKILLS AND EXPERIENCE:
  • Deep low-level systems programming (C/C++/PTX/SASS)
  • Strong experience with large-scale GPU clusters or distributed compute infrastructure at production scale
  • Hands-on work with GPU kernel optimization (CUTLASS, custom kernels, Nsight profiling)
  • Track record of building or running high-performance infrastructure for AI workloads (training or inference platforms)
  • Ability to reason from first principles and optimize for both memory-bound and compute-bound scenarios
COMPENSATION AND BENEFITS:

$220,000 - $357,000 USD

Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

SpaceXSI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

HQ

xAI Palo Alto, California, USA Office

1450 Page Mill Road, Palo Alto, CA, United States

xAI San Francisco, California, USA Office

3180 18th St., San Francisco, CA, United States

Similar Jobs

An Hour Ago
Remote or Hybrid
United States
107K-160K Annually
Mid level
107K-160K Annually
Mid level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The role involves managing outsourced accounting for nonprofits, leading teams, preparing financial reports, and improving operational efficiencies.
Top Skills: Bill.ComIntaactMicrosoft Office SuiteNetSuiteQuickbooks Online
2 Hours Ago
In-Office
82K-150K Annually
Junior
82K-150K Annually
Junior
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Supports customer qualification, technical debugging, product readiness, documentation, performance analysis, and issue resolution for NAND and SSD products. Collaborates with engineering, product, quality, and customer teams while contributing to AI-enabled automation, knowledge management, and technical support initiatives.
Top Skills: Ai ToolsChatgptClaudeCopilotData Center TechnologiesNand FlashNvmePciePythonScriptingSsdStorage Architectures
2 Hours Ago
In-Office
150K-308K Annually
Senior level
150K-308K Annually
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Supports advanced HBM DRAM design by interfacing with foundries, evaluating semiconductor technologies, performing HSPICE and circuit analyses, validating test chips and silicon, assessing PDKs, enabling design flows, and improving engineering productivity through AI and automation. The role requires expertise in advanced CMOS, FinFET devices, process integration, device characterization, PPA analysis, parasitic extraction, and physical verification, with collaboration across design, foundry, manufacturing, and product engineering teams.
Top Skills: AIBeolCadCmosDramFinfetHbmHspiceParasitic ExtractionPdkPhysical VerificationSpiceTsv

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account