Exa (exa.ai) Logo

Exa (exa.ai)

Software Engineer, Infrastructure

Reposted 10 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
180K-350K Annually
Mid level
In-Office
San Francisco, CA, USA
180K-350K Annually
Mid level
The Infra Engineer will design and operate large-scale infrastructure, focusing on reliability, observability, and optimization across GPU clusters and Kubernetes systems.
The summary above was generated by AI

Exa is an applied AI lab building a search engine unlike the world has ever seen. We build massive-scale infra to crawl the entire web, train state-of-the-art embedding models to process it, and design super high performant vector databases to retrieve over it. We now power search for Cursor, Cognition, HubSpot, and over 400,000 developers and have raised $350m from Lightspeed, Benchmark, and a16z.

 

Our ultimate goal is to build perfect search over all the world's information, far beyond Google. If you want to build massive-scale ML systems that will define the way the new AI world consumes information, this is the place for you.

 

Our Infrastructure Team builds the underlying tooling and infrastructure that powers all Exa's systems. Basically, infra engineers build the machine that builds the machine so that we can move as fast as possible as an engineering org. That could mean building GPU cluster orchestration in Kubernetes, map-reduce batchjobs on Ray, or the best observability tooling in the world.

 
Who You Are
  • You’re obsessed with scale and complex distributed systems

  • You have an aversion to ClickOps and would always build an automation

  • You max out OSS models’ GPU flops utilization just for the challenge

  • You play with Arch or NixOS as a personal driver for fun or ideology

  • You’re passionate and discerning about AI tooling — AI can 10x our velocity but also 10x the strain on our systems (CI, etc) and that challenge excites you

 
What You'll Do
  • Scale infrastructure to process the whole web on GPUs cost efficiently

  • Orchestrate multi-region, multi-cloud inference and training on GPUs

  • Ship a new version of our LLM gateway

  • Make the world's most advanced build cache with Nix

  • Build custom CI and code infrastructure that scales for our agent fleet

  • Automate software maintenance and improvements for the whole company

Logistics
  • Location: This is an in-person opportunity in San Francisco.

  • Visas: We're happy to sponsor international candidates (e.g., STEM OPT, OPT, H1B, O1, E3). While we cannot guarantee your visa, we have historically been successful in sponsoring candidates from all over the world. If you receive an offer, our team will work hard to get you a visa.

  • Benefits: We offer premium healthcare benefits (medical, dental, vision), fertility benefits, 16 weeks of fully paid parental leave for all new parents, and a monthly wellness stipend to all of our employees.

Exa is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, creed, color, religion, sex, sexual orientation, gender identity or expression, national origin, disability, age, veteran status, marital status, pregnancy or related conditions, criminal histories consistent with applicable law, or any other basis protected by applicable law.

Exa (exa.ai) San Francisco, California, USA Office

533 Page St, , San Francisco, California , United States, 94117

Similar Jobs

2 Days Ago
Hybrid
Sunnyvale, CA, USA
153K-234K Annually
Senior level
153K-234K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Design and build rendering infrastructure to run GPU-accelerated, physically-based sensor simulation at cluster scale. Integrate the renderer with AV stacks and ML training, ensure deterministic execution and timing fidelity, optimize GPU memory and throughput, implement multi-world execution and asset delivery, reduce cold-starts, and maintain profiling, testing, and cross-team collaboration.
Top Skills: C++ (C++17/20)CudaDdsDirectx Raytracing (Dxr)GrpcGymnasiumLinuxNvidia MdlNvidia OptixOpenusdOptix Ias/GasPtxPythonPyTorchRosRos2Shared-Memory IpcSocketsSquashfsVulkan
6 Days Ago
In-Office
Sunnyvale, CA, USA
182K-242K Annually
Senior level
182K-242K Annually
Senior level
Cloud • Information Technology • Machine Learning
Senior Software Engineer focused on AI infrastructure performance insights and observability. Responsible for designing and building monitoring, instrumentation, metrics, and tooling to measure and optimize compute and platform performance while collaborating with infrastructure and ML teams.
8 Days Ago
Easy Apply
In-Office
Easy Apply
154K-230K Annually
Senior level
154K-230K Annually
Senior level
Aerospace • Hardware • Robotics • Software • Manufacturing
Own and evolve Relativity's agentic infrastructure: agents, model routing, context pipelines, inter-agent communication, and supporting services. Deploy and operate local LLM inference across Mac Studio and GPU hardware, manage Linux/macOS systems, Proxmox VMs/containers, multi-site networking, storage and recovery. Build CLIs, dashboards, automation, improve observability and failure recovery, contribute upstream open-source, design security for local compute and package the stack for internal and customer deployments.
Top Skills: ContainersDnsFirewallsGiteaGitGpu HardwareHermesL3 RoutingLinuxLlama.CppLocal Llm InferenceMac StudiomacOSMechatronMlxMultigraphOllamaOpenclawParametric CadProxmoxSybilclawVlansVllmVmsYapcad

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account