SambaNova Systems Benefits Overview

Develop and optimize compiler infrastructure for SambaNova’s RDU AI accelerator. Responsibilities include implementing IR passes, lowering and partitioning machine learning models, tensor tiling, on-chip memory management, fabric mapping, and low-level debugging in C++ and Python. The role collaborates with runtime and hardware teams and includes mentorship while building production compiler software.

Build and operate the machine learning inference stack for SambaNova’s RDU accelerators. Develop production Python features including speculative and constrained decoding, tool calling, prompt caching, long-context inference, and vLLM integration. Maintain public inference APIs, create accuracy and regression tests, and troubleshoot latency, throughput, and reliability issues. The role requires strong systems and programming fundamentals, experience with LLM serving frameworks and inference techniques, and PyTorch knowledge.

Build and maintain cloud and on-premises infrastructure supporting SambaNova’s AI inference platform. Responsibilities include managing Kubernetes clusters, Terraform and Ansible automation, monitoring and dashboards, CI/CD pipelines, regional infrastructure deployment, capacity support, and incident response. The role also participates in an on-call rotation and requires programming or scripting, cloud, networking, Linux, containerization, infrastructure-as-code, and monitoring experience.