LiteLLM is the world’s most popular AI Gateway used by the largest companies (Adobe, Netflix, NASA, etc.) in the world to give their developers access to LLMs and adjacent services (MCP’s, Vector Stores, etc.).
About the RoleWe're looking for a Solutions Architect to collaborate with our key customers, helping them successfully deploy and scale LiteLLM in production. You'll work directly with customers with primarily pre-sales, along with some post-sales, conducting demos, responding on complex architecture issues, and ensuring that our customers extract maximum value from the platform.
This role is ideal for someone who thrives in dynamic, customer-facing environments, enjoys solving customer challenges in real-time, and can translate customer needs into actionable product improvements.
ResponsibilitiesDesign, implement, and optimize solutions for our customers in pre-sales and post-sales capacities.
Collaborate with customers to identify business needs and tailor product integrations.
Partner closely with engineering and product teams to drive roadmap and deliver mission-critical features.
Serve as a technical and domain expert, bridging the gap between AI innovation and client requirements.
Build and document best practices and solution templates for rapid deployment.
3+ years of experience in sales engineering, solution engineering, technical consulting, or related roles in high-growth startups or tech companies.
Strong experience working with a developer audience, selling a technical product
Strong technical background; experience with Python and AI/ML products highly preferred.
Excellent communication, relationship-building, and problem-solving skills.
Proven ability to operate with autonomy in fast-paced, high-ownership environments.
You thrive working directly with customers at a fast-growing startup—scoping complex technical challenges, leading implementation discussions, and driving them to production success
You love working closely with developers (30K+ Github stars) and being at the intersection of product and customer
You want to work hard and move fast in a high-impact role
You want to see firsthand how AI is transforming businesses—our customers run ALL their LLM calls through LiteLLM
You enjoy the autonomy and variety of working across multiple customer environments and technical stacks
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere] and is used by companies like Rocket Money, Adobe, Twilio, and Siemens.
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine



