Jobs at LiteLLM

The Senior Backend Engineer will design and scale backend guardrails, enhance observability tools, ensure error transparency, and maintain compliance for high-volume traffic systems.

The Developer Evangelist will cultivate a developer community, engage with customers, create content, and gather feedback to drive product decisions.

Lead and own the end-to-end migration of LiteLLM from Python to Rust: plan architecture with the CTO, restructure the codebase, execute a stability-first gradual rollout, and drive large-scale performance improvements for a high-volume LLM gateway.

Own the support queue, diagnose and reproduce customer issues, drive root-cause fixes, submit pull requests for bug fixes, and act as the technical voice of the customer to ensure successful use of the LiteLLM product.

Lead and manage an engineering team building an open-source AI gateway: own delivery, quality, release health, metrics, incident management, hiring, and enterprise escalations. Drive technical roadmap (including a Rust migration), architect consistent code patterns, and support open-source community adoption.

Lead and build company-wide operations for sales, customer success, finance, and cross-functional execution. Create playbooks, SLAs, KPIs, forecasting and performance tracking; recruit and manage teams; bridge product, engineering, and GTM; and iterate operational processes to scale the business.

As a Solutions Architect, you will design and optimize customer solutions for deploying LiteLLM, collaborating with customers and engineering teams to ensure successful implementations.