Jobs at LiteLLM

Own and drive success for LiteLLM's top accounts as the technical point of contact. Proactively prevent churn, unblock customer issues, assist with rollouts, surface product gaps to engineering, and maintain regular customer communication to increase usage and ensure renewals.

Work with founders to define and build LiteLLM's second product: talk to customers, design solutions, prototype, and ship production features. Build backend APIs and services with Python and FastAPI, improve developer experiences across API, dashboard, and CLI, and own major product areas end-to-end from concept to production.

Own and triage the support queue for LiteLLM, diagnose and reproduce customer issues, drive root-cause fixes, submit pull requests for bugs, and represent customer needs to engineering.

Founding Developer Relations is a hands-on technical IC who builds runnable demos, sample apps, tutorials, and launch materials; engages and supports the developer community; turns feedback into product improvements; and defines the DevRel strategy and launch processes.

Build and maintain a provider-agnostic LLM interoperability layer: transform OpenAI/Anthropic spec calls to other provider formats, implement session management, support provider features (skills, batching), and improve developer experience via the Python SDK. Work closely with founders and engage with users to ship production features.

Work directly with founders to research customer needs, design and implement features, write production code (50% coding), and ship developer-focused products. Build backend APIs and services, improve dashboards and CLI, prototype, and iterate based on user feedback to own major product areas end-to-end.

Own product quality across provider integrations by building conformance tests, CI/release tooling, canary/synthetic detection, and release channels. Drive regressions toward zero, perform root cause analysis, convert escapes into permanent tests, and raise engineering standards through code and reviews.

Lead and own the end-to-end migration of LiteLLM from Python to Rust: plan architecture with the CTO, restructure the codebase, execute a stability-first gradual rollout, and drive large-scale performance improvements for a high-volume LLM gateway.

The Senior Backend Engineer will design and scale backend guardrails, enhance observability tools, ensure error transparency, and maintain compliance for high-volume traffic systems.

Lead and manage an engineering team building an open-source AI gateway: own delivery, quality, release health, metrics, incident management, hiring, and enterprise escalations. Drive technical roadmap (including a Rust migration), architect consistent code patterns, and support open-source community adoption.