EXL Logo

EXL

GenAI / Agentic Architect

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Lead enterprise GenAI strategy and architecture across the 7-layer LLM stack. Advise C-suite, design scalable ingestion and RAG/agentic pipelines, implement observability (token tracing, drift/hallucination monitoring), enforce data protection/DLP and semantic caching, and oversee large onshore client delivery and technology trade-off decisions.
The summary above was generated by AI

Direct the enterprise GenAI technology portfolio and lead large-scale, onshore client engagements. 

Act as a trusted senior technical architect and advisor to client leadership, bridging the gap between cutting-edge AI capabilities and core business transformation. 

Oversee multiple architectural delivery streams, making high-impact decisions on technology stacks, framework selection, and infrastructural trade-offs across the 7-layer AI stack.

Responsibilities
  • Enterprise AI Strategy & Trade-Off Analysis: Define multi-year GenAI roadmaps by evaluating structural architecture trade-offs across the 7-layer LLM stack. Compare Commercial APIs (e.g., GPT-4o, Claude 3.5 Sonnet) vs. Hosted Open-Source LLMs (e.g., Llama 3) based on cost, latency, and data privacy.
  • Advanced Architecture Oversight: Review and approve macro-level AI architectures. Architect scalable data ingestion pipelines, selecting between standard semantic RAG, Agentic RAG, or GraphRAG depending on enterprise complexity.
  • Advanced Observability & Monitoring: Design deeply integrated AI observability (OBS) layers tailored for LLMs. Implement specialized tools (e.g., LangSmith, Phoenix, Arize) to track token consumption, trace complex agentic reasoning loops, and monitor model drift and hallucination rates in production.
  • Robust Data Protection Strategy: Architect comprehensive data protection pipelines utilizing Enterprise Data Loss Prevention (DLP) tools. Ensure data is sanitized before hitting external APIs and implement robust semantic caching to prevent sensitive data leakage.
  • Executive Consulting & Technical Pitching: Lead onshore client-facing engagements, pitching complex AI solutions to C-suite stakeholders, translating engineering trade-offs into clear financial and operational ROI frameworks.
Qualifications
  • Consulting Skills: High-impact executive presence; extensive experience in technology consulting, solution scoping, and technical proposal architecture.
  • Senior Technical Architecture Mastery: Deep hands-on background in enterprise integration patterns. Expert-level capability in comparing orchestration layers (e.g., LangChain vs. LlamaIndex vs. Semantic Kernel) and evaluating modern execution environments (vLLM, TensorRT-LLM).
  • Cloud & Vector Strategy: Deep familiarity with dictating enterprise data storage choices by comparing managed vector services (Pinecone) vs. distributed open-source engines (Milvus/Qdrant) or extending existing relational systems (pgvector).
  • Qualifications: Master’s in computer science, AI, or IT Management; 12–18 years of progressive IT/AI experience, heavily indexing on senior technical architecture and client delivery.

The typical base pay range for this role across the U.S. is USD $200,000 - $280,000 per year.

For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits


The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale.

Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position.


The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.

EXL Richmond, California, USA Office

Richmond, United States

Similar Jobs

3 Days Ago
In-Office or Remote
4 Locations
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design and deploy AI applications for telecommunications networks, focusing on generative models and infrastructure improvements, while providing technical guidance and building enterprise solutions.
Top Skills: SparkC++ElasticsearchMorpheusNemoNoSQLNvidia Data Acceleration SdksPandasPythonPyTorchRapidsSQL
12 Minutes Ago
Remote or Hybrid
55K-75K Annually
Junior
55K-75K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound insurance sales calls and warm leads, assess customer needs, recommend Property & Casualty coverages, close policy sales, complete paid licensing/training, follow set schedules, and meet performance and quality expectations in a remote workspace.
13 Minutes Ago
Remote or Hybrid
55K-75K Annually
Junior
55K-75K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound insurance sales calls and warm leads, consult customers on coverage needs, match products, close sales, and complete paid licensing/training. Remote role with set shift schedule, W@H technical requirements, and day-one benefits.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account