LTS Logo

LTS

Senior Applied AI Engineer

Reposted 28 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Design, prototype, and productionize applied AI capabilities (LLMs, RAG, agents) to improve reasoning, explainability, and developer productivity. Optimize retrieval, embeddings, multi-agent workflows, and evaluation frameworks; build benchmarks and diagnostics. Collaborate with architects and engineers to ingest enterprise knowledge, refine semantic search, and transition experiments into FedRAMP-aligned production for federal healthcare modernization.
The summary above was generated by AI

Location: United States – Remote
Clearance: Ability to obtain and maintain a Public Trust
Salary Range: 144K - 184K

LTS is seeking a highly skilled Senior Applied AI Engineer to focus on continuously improving the intelligence behind the platform. You'll experiment with models, optimize retrieval strategies, refine agent reasoning, evaluate AI performance, and transform emerging AI capabilities into production-ready solutions.

The Agentic AI platform is designed to help engineers understand, analyze, and modernize one of the most consequential legacy software systems still operating today.

Our platform enables engineers to ask questions in plain English and receive explainable, verifiable answers traced directly back to decades of production source code. Rather than replacing engineers, we're building AI that accelerates engineering through transparency, traceability, and intelligent reasoning.

We're building an AI-native engineering platform supporting the modernization of mission-critical healthcare systems serving millions of Veterans nationwide.

The platform is designed for deployment across federal enterprise environments and is being engineered to align with FedRAMP security controls, Zero Trust principles, and federal compliance requirements.

The platform has executive sponsorship, committed users, and a customer investing in long-term modernization. Our engineering team is intentionally small giving every engineer meaningful ownership, and direct influence over product direction.

We don't simply build AI-powered software—we build software with AI. This is not another chatbot.

Using LLMs, autonomous agents, AI-assisted development, parallel workflows, and model-driven engineering is simply how we work.

What You’ll Do:

Advance Applied AI Capabilities

  • Design, prototype, and implement production-ready AI capabilities that improve reasoning, accuracy, explainability, and developer productivity.
  • Evaluate emerging LLMs, multimodal models, agent frameworks, and AI techniques to identify opportunities for platform advancement.
  • Rapidly prototype new AI capabilities and transition successful experiments into production.

Optimize Agent Performance

  • Improve autonomous and multi-agent workflows through prompt engineering, reasoning optimization, memory strategies, tool selection, and context management.
  • Continuously refine Retrieval-Augmented Generation (RAG) pipelines, retrieval strategies, embeddings, reranking, and grounding techniques.
  • Improve AI response quality through experimentation, benchmarking, and iterative optimization.

Evaluate AI Systems

  • Develop evaluation frameworks that measure accuracy, groundedness, explainability, latency, and overall AI effectiveness.
  • Build benchmark datasets, automated evaluation pipelines, and performance metrics for production AI systems.
  • Analyze AI failures, hallucinations, retrieval gaps, and reasoning errors to drive continuous improvement.

Knowledge Engineer

  • Collaborate with software engineers to improve knowledge ingestion, document processing, semantic search, embeddings, and enterprise knowledge management.
  • Design approaches that maximize retrieval quality across large technical documentation and source code repositories.
  • Improve how AI agents discover, organize, and reason over enterprise knowledge.

Collaborate Across Engineer

  • Partner closely with AI architects, platform engineers, software engineers, and front-end engineers to improve the overall intelligence of the platform.
  • Share research findings, experimental results, and engineering recommendations with cross-functional teams.
  • Help establish best practices for experimentation, evaluation, and AI quality throughout the organization.

What We’re Looking For:

  • Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Software Engineering, Engineering, Data Science, or a related technical discipline (or equivalent professional experience).
  • 5+ years of software engineering, applied AI, machine learning, or AI systems development experience.
  • Demonstrated experience developing production AI applications powered by Large Language Models (LLMs).
  • Experience designing and optimizing Retrieval-Augmented Generation (RAG) systems.
  • Experience with prompt engineering, embeddings, semantic search, vector databases, and knowledge retrieval.
  • Experience evaluating AI model performance and implementing experimentation frameworks.
  • Strong programming skills in Python and experience with modern software engineering practices.
  • Experience with AI frameworks such as LangGraph, LangChain, LlamaIndex, Semantic Kernel, CrewAI, AutoGen, or similar.
  • Experience with using AI coding assistants as part of your daily workflow.
  • Familiarity with REST APIs, cloud-native applications, and distributed software systems.
  • Strong analytical, problem-solving, and communication skills.
  • Intellect and curiosity for AI systems and how they behave.
  • Deep passion for experimenting with new AI techniques.
  • Background in evaluation, explainability, and continuous improvement.
  • Proven success with ownership of difficult technical challenges and collaboration across disciplines.

Nice to Have:

  • Experience optimizing autonomous or multi-agent AI systems.
  • Experience implementing automated AI evaluation frameworks.
  • Experience with OpenAI, Azure OpenAI, Anthropic Claude, Google Vertex AI, AWS Bedrock, or open-source LLMs.
  • Experience with vector databases including Pinecone, Weaviate, Qdrant, Milvus, or Azure AI Search.
  • Experience with Responsible AI, AI governance, safety, and explainability.
  • Familiarity with software engineering tools, code intelligence platforms, or developer productivity solutions.
  • Experience supporting healthcare, Federal Government, or other highly regulated environments.
  • Experience using AI coding assistants and autonomous agents as part of daily software development.

What’s In It for You?

  • The Opportunity to support high-visibility federal missions
  • A culture that values innovation, growth, and collaboration
  • Access to cutting-edge tools and technologies
  • Comprehensive benefits for you and your family
  • A career path that rewards ambition and performance

If you’re ready to push boundaries, sharpen your skills, and join a team that is passionate about building what’s next, we’d love to meet you. Apply today and let’s build a future together!

LTS shares salary ranges to promote transparency. Compensation ranges are provided for informational purposes, and final compensation may vary based on experience, skills, location, and role requirements.

LTS is committed to offering eligible employees comprehensive benefits that will provide them with options intended to meet their needs and the needs of their family.

Similar Jobs

Yesterday
In-Office or Remote
48 Locations
150K-205K Annually
Senior level
150K-205K Annually
Senior level
Information Technology • Consulting
Build and operationalize production AI solutions for federal clients, from stakeholder discovery and architecture through evaluation, deployment, governance, monitoring, and optimization. Develop LLM applications using retrieval, structured outputs, tool use, and agentic workflows. Define quality metrics, create evaluation sets, document limitations, advise clients on AI use cases, and mentor engineers while contributing to reusable internal patterns and products.
Top Skills: Agentic WorkflowsAPIsAppianAws BedrockAzure OpenaiLarge Language ModelsMendixMicrosoft Power PlatformOutsystemsPrompt EngineeringPythonRetrieval-Augmented GenerationSalesforceServicenowSQLStructured ExtractionTool UseTypescript
3 Days Ago
In-Office or Remote
150K-180K Annually
Senior level
150K-180K Annually
Senior level
Robotics
Design, build, and operate AWS-based microservices and asynchronous workflows powering AI-driven laboratory protocol generation. Develop NLP pipelines, classifiers, embedding and RAG infrastructure, evaluation frameworks, guardrails, cost monitoring, and observability. Integrate AI systems into production SaaS architecture, ensure reliability and safe scaling, and support post-launch operations through debugging, incident response, and continuous improvement.
Top Skills: AWSCi/CdFastapiGitLarge Language Models (Llms)MicroservicesNatural Language Processing (Nlp)PythonReactRestful ApisRetrieval-Augmented Generation (Rag)Typescript
4 Days Ago
Remote
United States
165K-205K Annually
Senior level
165K-205K Annually
Senior level
Healthtech • Pharmaceutical
Build and ship production AI capabilities using AWS Bedrock, including clinical document extraction, summarization, retrieval, decision support, and workflow automation. Develop Python and FastAPI applications, integrations, tests, CI gates, and evaluation systems. Work with healthcare data standards, PHI, AWS, MySQL, and server-rendered front ends. Use and verify AI coding tools while communicating tradeoffs clearly in a remote, Linux-based environment.
Top Skills: Alpine.JsAWSAws BedrockClaude CodeEmbeddingsFastapiJinja2KiroLinuxLlamaLlmsMistralMySQLNcpdp D.0OcrOllamaPostgresPrompt EngineeringPythonQwenRetrieval-Augmented GenerationScikit-LearnSftpTailwind CssTgiVllmWindowsX12 270/271Xgboost

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account