Build and ship production infrastructure for reliable AI agents handling complex, multi-step tasks. Responsibilities include agent execution, retrieval and memory systems, evaluation harnesses, production improvements, customer collaboration, orchestration, and hiring. The role requires owning the full development cycle and improving agent performance using real-world feedback.
Applied AI Engineer
Requirements
San Francisco, CA · On-site · Full-time
Relocation and visa sponsorship available
We’re building AI agents that work reliably in production—not just in demos. As our Applied AI Engineer, you’ll own the infrastructure that helps agents handle complex tasks, retain useful context, and know when to bring in a human.
You’ll ship to production in your first week and help shape how our agents plan, remember, fail, and recover.
- Build infrastructure for reliable agent execution across long, multi-step tasks.
- Design retrieval and memory systems that make messy operational data useful over time.
- Develop evaluation harnesses teams can trust when deciding what’s ready to ship.
- Improve production systems through the full cycle: build, measure, test, fix, and learn.
- Work with customers and use real-world feedback to strengthen agent performance.
- Take ownership across infrastructure, orchestration, customer collaboration, and hiring.
Requirements
What we’re looking for
- 3+ years of relevant experience building and shipping production AI systems.
- Strong Python skills and hands-on experience with agent orchestration.
- Experience building retrieval and memory
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Build and deploy secure, production-grade AI solutions for go-to-market teams using retrieval, structured-data querying, and agentic workflows. Partner with GTM leaders to define AI strategy, roadmaps, and build-versus-buy decisions. Establish monitoring, evaluation, security, and ROI frameworks tied to revenue outcomes. Drive adoption through enablement and feedback loops, develop reusable AI architecture and data connectors, improve engineering standards, and mentor other engineers.
Top Skills:
A/B TestingAgent-To-Agent (A2A) FrameworksAgentic WorkflowsCloud PlatformsGraphragKnowledge GraphsLlm-As-JudgeModel Context Protocol (Mcp)PythonRegression TestingRetrieval-Augmented Generation (Rag)
Security • Software • Cybersecurity • Automation
Lead applied AI research focused on information retrieval, RAG, agentic workflows, ranking, reasoning, and evaluation. Build prototypes, golden datasets, quality metrics, regression detection, and experimentation frameworks; investigate failure modes and validate improvements through rigorous testing. Collaborate with AI and software engineers to productionize successful approaches and stay current with research in RAG, agents, LLM evaluation, and relevance modeling.
Top Skills:
A/B TestingCross-EncodersEmbedding ModelsGenerative AiGraph Link PredictionHybrid SearchInformation RetrievalKnowledge GraphsLearning-To-RankLlm RerankersMachine LearningNlpPythonRagSemantic RoutingVector Databases
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Leads global teams developing production AI, GenAI, RAG, agentic workflow, and MLOps solutions for health systems and health plans. Translates clinical, financial, and operational challenges into HIPAA-compliant use cases involving clinical decision support, population health, revenue cycle, research, and optimization. Oversees healthcare data science engagements, model governance, executive stakeholder communications, client delivery, and team development.
Top Skills:
Anthropic ClaudeAws BedrockAws SagemakerAzure Health Data ServicesAzure Machine LearningAzure Openai ServiceChromaCi/CdDatabricksGitGoogle Vertex AiKerasLangchainLlamaindexMlopsNoSQLPandasPineconePythonRagScikit-LearnSemantic KernelSnowflakeSQLTransformers
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
