Handshake Logo

Handshake

Senior Software Engineer, AI Infrastructure

Reposted 18 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
176K-220K Annually
Mid level
In-Office
San Francisco, CA, USA
176K-220K Annually
Mid level
As a Senior Software Engineer, you will build and architect the AI infrastructure, focusing on agent orchestration and collaborating with cross-functional teams to enhance product features for a large user base.
The summary above was generated by AI
About Handshake

Handshake is the career network for the AI economy. 20 million knowledge workers, 1,600 educational institutions, 1 million employers (including 100% of the Fortune 50), and every foundational AI lab trust Handshake to power career discovery, hiring, and upskilling, from freelance AI training gigs to first internships to full-time careers and beyond. This unique value is leading to unparalleled growth; in 2025, we tripled our ARR at scale.

Why join Handshake now:

  • Shape how every career evolves in the AI economy, at global scale, with impact your friends, family & peers can see & feel

  • Work hand-in-hand with world-class AI labs, Fortune 500 partners & the world's top educational institutions

  • Join a team with leadership from Scale AI, Meta, xAI, Notion, Coinbase, & Palantir, among others

  • Build a massive, fast-growing business with billions in revenue

The Role

Handshake is building the infrastructure layer that powers the next generation of AI agents across our platform. As a Senior Software Engineer on our Agentic Infrastructure team, you'll be at forefront of AI at Handshake, will architect & build the foundational systems that allow AI agents to plan, execute, & operate autonomously at scale. This is a rare greenfield opportunity to define how an AI-first company builds for the agentic era — at the intersection of infrastructure, AI, & direct product impact.

  • Architect & build the core agent orchestration layer — including tool use, memory, & multi-step reasoning systems — that powers AI-driven features for 20M+ users & 1M+ employers across Handshake's platform

  • Design evaluation, observability, & reliability frameworks that ensure agent behavior is safe, auditable, & production-ready at scale

  • Establish engineering standards for agentic development across Handshake's platform teams, enabling every engineer to build with AI

  • Partner with ML, product, & platform engineers to ship agent-powered features from infrastructure to production at Olympic pace

You Have

Must-Haves:

  • 4-7 years of backend engineering experience, with strong proficiency in NodeJS, Typescript, &/or Python

  • Experience designing & operating distributed systems at significant scale for developer experience

  • Hands-on experience building with LLM orchestration frameworks (LangChain, LlamaIndex, or similar)

  • Deep understanding of agent architectures: tool use, multi-step reasoning, memory management, & evaluation

  • Experience with cloud infrastructure (AWS, GCP, or Azure) & infrastructure-as-code tools like Terraform

  • Experience with Node, JavaScript, CICD, Docker

  • A track record of shipping production systems with high reliability, low latency, & strong observability

  • Strong communication skills & ability to drive alignment across engineering & cross-functional partners

Bonus Points:

  • Open-source contributions to LLM or agent frameworks

  • Prior experience at an AI-native company or on a dedicated AI platform team

We Offer

Handshake delivers benefits that help you feel supported — and thrive at work and in life.

The below benefits are for full-time US employees.

🎯 Ownership: Equity in a fast-growing company

💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching

🍼 Family Support: Paid parental leave, fertility benefits, parental coaching

💝 Wellbeing: Medical, dental, & vision, mental health support, $500 wellness stipend

📚 Growth: $2,000 learning stipend, ongoing development

💻 Remote & Office: Internet, commuting, & free lunch/gym in our SF office

🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days

🤝 Connection: Team outings & referral bonuses

Explore our mission, values, & comprehensive US benefits at joinhandshake.com/careers.

HQ

Handshake San Francisco, California, USA Office

We're located right in the center of everything in the financial district of downtown San Francisco. We're just 1 block from Montgomery St Bart!

Similar Jobs

11 Days Ago
In-Office
Santa Clara, CA, USA
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design and build AI-native, high-performance CI/build/test/validation infrastructure for large Tegra C/C++ codebases. Optimize build graphs, caching, incremental builds, remote execution, device-lab testing, and integrate reasoning agents for autonomous triage, remediation, and self-healing workflows. Package reusable platform capabilities, drive adoption, and measure developer feedback loop improvements.
Top Skills: Agent WorkflowsAi Coding ToolsBuild GraphsCC++CachingCi/Build SystemsDevice LabEmulationIncremental BuildsPythonRemote ExecutionSimulationTegra
19 Days Ago
In-Office or Remote
3 Locations
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Lead the optimization and performance analysis of distributed training and inference workloads on NVIDIA GPU platforms, with responsibilities including debugging, benchmarking, and ensuring reliability of large-scale AI systems.
Top Skills: C/C++Containerized EnvironmentsCudaInfinibandMegatronNcclNemoNsight SystemsNvlinkNvswitchPciePythonPyTorchRdmaRoceTensorrt-Llm
15 Days Ago
In-Office or Remote
Santa Clara, CA, USA
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The role involves developing AI infrastructure for large-scale workloads, enhancing system reliability, and optimizing performance, requiring extensive experience in AI software systems.
Top Skills: C/C++DynamoElkJaxKubernetesLokiPrometheusPythonPyTorchRayTensorFlow

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account