Lead and evolve Coupa's LLM/GenAI platform: define architecture and strategy, build MLOps pipelines, manage deployment/lifecycle of LLMs and embeddings, implement IaC and multi-cloud infrastructure, mentor platform engineers, ensure reliability, observability, and enterprise-grade scalability/security.
Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.
Why join Coupa?
🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.
🔹 Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.
🔹 Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other.
Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa.
The Impact of a Lead Cloud Software Engineer at Coupa:
AI is reshaping how the world builds, learns, and connects. At our company, we believe the next generation of enterprise software will be powered by AI-driven platforms that are secure, scalable, and built for constant innovation. As our Lead of AI LLM Platform DevOps team, you will build solutions that enable this vision. From CI/CD pipelines, ML Ops, GenAI, Agentic AI platforms to AI governance and observability, you will define how our engineers build, test and ship the technologies that power global enterprises. This is your chance to lead & shape the evolution of Coupa’s AI platform. You will lead system design, code development, deployment, automation for our LLM/GenAI/Agentic AI platforms ensuring reliability, scalability of infrastructure.
What You’ll Do
- Lead Platform Architecture and Strategy: Define and drive the long-term technical vision for Agentic AI platform and LLM infrastructure, making strategic decisions on technology choices, architectural patterns and platform evolution.
- Design Enterprise-Scale Platform Solutions: Architect complex, multi-tenant platform systems that support high availability, scalability, and security requirements across global multi-cloud environments
- Drive Technical Leadership and Mentorship: Lead and mentor a team of platform devops engineers, providing technical guidance, code reviews, and career development while fostering a culture of engineering excellence
- Establish Platform Engineering Standards: Define and implement best practices, coding standards and architectural principles that ensure consistency, reliability, and maintainability across all platform components
- Involve in evaluation of new products and technologies like RAG, MCP servers. AI Agents, Agentic Workflows, etc.
- Deployment and Life cycle Management of LLM & Embedding Models.
- Build and manage MLOps pipeline.
- Infrastructure As Code (IaC e.g Terraform) with Multi Cloud Deployments.
- Ensure technical quality through code reviews, architecture discussions, and engineering standards.
- Collaborate with the Principal Architect and AI/ML Engineering Lead on technical direction.
- Collaborate with platform, Dev & QE teams to plan & deploy the releases.
- Participate in design reviews, code reviews, troubleshooting incidents & write, and review Incident RCAs
What You Will Bring to Coupa
- Senior Platform Engineering Leadership: 10+ years of hands-on platform engineering experience with 3+ years in technical leadership roles, including experience managing complex cloud infrastructure at enterprise scale
- Advanced Cloud Architecture Expertise: Deep expertise in cloud-native architectures, multi-cloud strategies, and advanced services across AWS or GCP, with proven experience designing systems that handle millions of transactions
- Enterprise Platform Design: Proven track record designing and implementing large-scale platform solutions, including microservices architectures, container orchestration, and distributed systems patterns
- Advanced Automation and Programming: Expert-level programming skills in multiple languages (Python, Go, Java, etc.) with extensive experience building sophisticated automation frameworks and platform tools
- Strategic CI/CD and DevOps: Deep expertise in enterprise CI/CD design, MLOps pipelines, and DevOps transformation initiatives, with experience implementing these practices across large engineering organizations
- Architectural Decision Making: Proven ability to make complex technical trade-offs, evaluate emerging technologies, and drive architectural decisions that balance current needs with long-term scalability
- Enterprise AI platform infrastructure development experience
- Experience building enterprise grade, scalable, cost-efficient, secure AI/ML platforms with a focus on resiliency, automation, observability.
- Deployment and Life cycle Management of LLM & Embedding Models (OpenAI, AWS Bedrock, Amazon SageMaker) and Vector Databases like LanceDB
- Exposure to evaluation of new products and technologies like RAG, MCP servers, AI Agents, Agentic Workflows, LangChain etc.
- Manage AWS core & AI /GenAI services (S3, IAM, EKS, Bedrock, etc), Expert in IaC (Terraform).
- Containerization and Orchestration: Deep knowledge of Docker and Kubernetes (especially GKE or EKS) for scaling inference services, Build, deploy workloads.
- A leader who thrives in fast-moving environments, motivates teams, and embraces innovation.
- Strong communication skills across geographies.
- BS/MS in Computer Science or equivalent experience.
#LI-HYBRID
#LI-AA2
Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees.
Please be advised that inquiries or resumes from recruiters will not be accepted.
By submitting your application, you acknowledge that you have read Coupa’s Privacy Policy and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.
Coupa Foster City, California, USA Office
Coupa Foster City Office
950 Tower Ln, Foster City, California, United States, 94404 2121
Similar Jobs at Coupa
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Lead the development and governance of AI systems at Coupa, driving excellence in model performance and MLOps while mentoring a team of data scientists and ML engineers.
Top Skills:
DatabricksGenerative AiKubeflowLlmsMlflowPythonPyTorchSagemakerTensorFlowVertex Ai
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
The Principal Engineer, AI/ML Architecture will define the technical direction for Coupa's AI platform, focusing on model training, evaluation, safety standards, and mentoring a team of ML and data engineers.
Top Skills:
Cloud Ai/Ml ServicesPythonPyTorch
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Lead strategy and delivery for Coupa's AI platform, expanding model training, serving, and data infrastructure. Build and manage distributed ML, data engineering, and platform teams across the US and India, manage vendor partnerships and budgets, ensure data safety and responsible AI, and present results to executive stakeholders.
Top Skills:
Cloud InfrastructureData PipelinesData Quality FrameworksFine-TuningFrontier Model IntegrationsModel ServingModel TrainingProduction MlRagResponsible AiTenant Isolation
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
