xAI Logo

xAI

ML Infrastructure Engineer

Posted 6 Days Ago
In-Office
Palo Alto, CA, USA
180K-440K Annually
Junior
In-Office
Palo Alto, CA, USA
180K-440K Annually
Junior
Build and scale GPU compute infrastructure, training frameworks, and data pipelines. Integrate large-scale training and inference systems, productionize models with ML teams, ensure scalability and reliability, troubleshoot full-stack ML systems, and mentor junior engineers.
The summary above was generated by AI

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

ABOUT THE ROLE:

As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional engineers who are passionate about our mission and have a strong desire to make a meaningful impact.

RESPONSIBILITIES:
  • Designing, building, and scaling GPU compute infrastructure, training frameworks, and experimentation tools to enable rapid iteration on ML hypotheses
  • Developing data pipelines and integrating large-scale data, training, and inference systems
  • Collaborating with ML teams to productionize models and ensure seamless integration across the stack
  • Ensuring scalability, reliability, and efficiency of large-scale machine learning systems
  • Working across the full stack to solve complex problems independently
  • Mentoring junior engineers and contributing to the growth of the team
BASIC QUALIFICATIONS:
  • Bachelor, Master, Post-graduate or PhD in computer science, machine learning, or other quantitative discipline; or equivalent work experience
  • 2+ years of industry experience working with high traffic or large-scale production environments, distributed systems, GPU infrastructure, and/or deep learning applications
  • 2+ years experience with ML platforms, training infrastructure, or close collaboration with modeling engineers and data scientists
  • Strong proficiency with Python and experience with compiled languages such as C++ or Rust
PREFERRED SKILLS AND EXPERIENCE:
  • Deep familiarity with modern ML frameworks such as JAX or PyTorch
  • Low-level understanding of compute systems, including distributed storage, NVIDIA drivers, CUDA toolkits, and networking
  • Comfortable with Linux systems and orchestration tools
  • Experience with job schedulers (e.g., Slurm), configuration management (Puppet/Ansible), or related infrastructure tooling
COMPENSATION AND BENEFITS:

$180,000 - $440,000 USD

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

HQ

xAI Palo Alto, California, USA Office

1450 Page Mill Road, Palo Alto, CA, United States

xAI San Francisco, California, USA Office

3180 18th St., San Francisco, CA, United States

Similar Jobs

5 Days Ago
Hybrid
Palo Alto, CA, USA
235K-414K Annually
Expert/Leader
235K-414K Annually
Expert/Leader
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Lead technical strategy, architecture, and implementation for ML inference platform services. Design and scale distributed, high-throughput inference systems, collaborate across teams, drive availability, scalability, operational excellence, cost management, and provide company-wide technical direction and mentorship.
Top Skills: Distributed SystemsGpuKubernetesLlm InferenceMl Inference PlatformPyTorchRpcTensorFlow
7 Hours Ago
In-Office or Remote
150K-250K Annually
Senior level
150K-250K Annually
Senior level
Transportation
Design, build, and operate scalable MLOps infrastructure for data ingestion, distributed training, deployment, CI/CD, experiment tracking, and monitoring across cloud R&D and production. Collaborate with ML, autonomy, robotics, and software teams to deliver architecture, PoCs, and production-ready ML pipelines that support real-time, safety-critical systems.
Top Skills: AirflowAWSAzureCi/CdGCPGitGpuHorovodKubeflowMetaflowMlflowPythonPytorch DdpRaySagemaker
5 Days Ago
Hybrid
Sunnyvale, CA, USA
189K-291K Annually
Senior level
189K-291K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Design, build, and deploy scalable ML training and evaluation platforms for autonomous driving. Lead architecture and implementation of distributed, high-performance pipelines, drive cross-team prioritization, mentor engineers, and support recruiting and code quality to accelerate ML model development lifecycle.
Top Skills: BazelBlazeBuckC++Cloud InfrastructureCmakeDistributed TrainingDockerGpu/Cpu ClustersKubernetesMlopsPythonPyTorchTensorFlow

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account