xAI Logo

xAI

Software Engineer - Kernels/CUDA (C++)

Reposted 10 Hours Ago
Be an Early Applicant
In-Office
Palo Alto, CA, USA
180K-440K Annually
Senior level
In-Office
Palo Alto, CA, USA
180K-440K Annually
Senior level
Design, build, and optimize massive GPU clusters and low-level CUDA kernels for AI training and inference. Work on Linux kernel internals, virtualization (KVM, Firecracker), custom orchestration, profiling, and infrastructure-as-code to maximize performance and scalability for production AI workloads.
The summary above was generated by AI

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

ABOUT THE ROLE:

We are building one of the world’s largest AI supercomputers from the ground up. As part of the Compute Infrastructure team, you will own both the raw GPU supercomputer and the platform layer that runs on top of it. You will work across the full stack — from low-level GPU kernel optimizations and Linux kernel internals to massive-scale orchestration and virtualization — to make training and inference at SpaceXAI as fast, reliable, and scalable as possible.

This is a broad, high-impact role that combines hardcore supercompute and compute infrastructure work. Your contributions will directly accelerate Grok’s training speed and overall AI progress.

RESPONSIBILITIES:

  • Design, build, and optimize massive GPU clusters for extreme-scale training and inference workloads
  • Develop and tune low-level CUDA kernels (GeMM, Attention, etc.), using CUTLASS, Tensor Cores, and Nsight for maximum performance
  • Profile, debug, and eliminate bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operation
  • Collaborate closely with AI research teams to deliver production-grade performance and scalability
PREFERRED SKILLS AND EXPERIENCE:
  • Deep low-level systems programming (C/C++/PTX/SASS)
  • Strong experience with large-scale GPU clusters or distributed compute infrastructure at production scale
  • Hands-on work with GPU kernel optimization (CUTLASS, custom kernels, Nsight profiling)
  • Track record of building or running high-performance infrastructure for AI workloads (training or inference platforms)
  • Ability to reason from first principles and optimize for both memory-bound and compute-bound scenarios
COMPENSATION AND BENEFITS:

$180,000 - $440,000 USD

Base salary is just one part of our total rewards package at SpaceXAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

HQ

xAI Palo Alto, California, USA Office

1450 Page Mill Road, Palo Alto, CA, United States

xAI San Francisco, California, USA Office

3180 18th St., San Francisco, CA, United States

Similar Jobs

15 Minutes Ago
In-Office
65K-95K Annually
Junior
65K-95K Annually
Junior
Manufacturing
Field-based retail sales role driving revenue across Millwork, In-Home, and Pro channels in a Northwest territory. Build and manage retailer relationships, deliver product training, ensure merchandising and pricing accuracy, support Pro and distributor programs, resolve customer issues, and execute sales initiatives. Requires frequent in-store visits, budgeted travel planning, and product/market feedback to internal teams.
Top Skills: HubspotMicrosoft DynamicsSalesforce
30 Minutes Ago
Remote or Hybrid
United States
88K-118K Annually
Senior level
88K-118K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Provide post-implementation Dynamics 365 Business Central functional and technical services, triage and resolve client tickets, design/configure BC solutions and extensions, run onboarding assessments, document knowledgebase articles, support account management and marketing efforts, and monitor emerging Microsoft/Business Central technologies.
Top Skills: Business Central ExtensionsBusiness Central Marketplace AppsBusiness Central SaasIsv SolutionsMicrosoft Business Central CertificationsMicrosoft Dynamics 365Microsoft Dynamics 365 Business CentralPtes
30 Minutes Ago
Remote or Hybrid
United States
88K-118K Annually
Senior level
88K-118K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Lead and deliver Dynamics 365 Business Central implementations for manufacturing and distribution clients. Drive configurations, integrations, functional and technical design, workshops, training, and ERP deployment using implementation standards. Gather requirements, recommend solutions (ISVs/customizations), develop functional design documents, and support client adoption and ongoing support.
Top Skills: Dynamics 365ErpMicrosoft Dynamics 365 Business Central

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account