Design, build, and optimize agentic AI solutions, including LLM prompts, agent workflows, MCP tools, tool-calling frameworks, RAG systems, and context orchestration. Develop evaluation methods, integrate enterprise systems and APIs, support deployment and monitoring, and ensure solutions meet security, governance, compliance, and responsible AI standards. The role is client-facing and involves collaboration across product, architecture, and engineering teams.
Job Description
AI Prompt Engineer / Agentic AI Engineer (3 ON, 3 Off)
Role Summary
- Role Type: Client-facing, hands-on engineering + solutioning (pre-sales through early delivery)
- Location: Major US hub (e.g., New York, Bay Area, Dallas, Chicago – flexible for the right candidate). Travel Expected.
- Level: Manager/Principal/Senior Principal
- Business Unit: (Enterprise AI Platforms & Agentic Solutions).
- Reporting to: Artificial Intelligence Leader, North America.
About Company:
Role summary
The resource will support the design, development, and delivery of Agentic AI solutions by creating, optimizing, and managing AI prompts, agent workflows, and MCP-integrated tools. The role will focus on enabling intelligent AI agents capable of autonomous reasoning, task orchestration, tool utilization, and workflow execution across enterprise applications.
Key Responsibilities
- Design, develop, and optimize prompts for Large Language Models (LLMs) to improve accuracy, reliability, and business outcomes.
- Build and configure Agentic AI solutions that leverage planning, reasoning, memory, and multi-step task execution capabilities.
- Develop and integrate MCP (Model Context Protocol) tools, enabling AIagents to securely discover and interact with enterprise systems, APIs, and data sources.
- Design agent architectures, tool-calling frameworks, retrieval mechanisms, and context management strategies.
- Collaborate with product managers, architects, and engineering teams to translate business requirements into AI-driven solutions.
- Implement Retrieval-Augmented Generation (RAG), knowledge grounding, and context orchestration patterns.
- Define evaluation frameworks and prompt testing methodologies to measure agent performance, quality, and reliability.
- Ensure AI solutions adhere to security, compliance, governance, and responsible AI standards.
- Support deployment, monitoring, troubleshooting, and continuous improvement of AI agents and MCP-enabled workflows.
- Contribute to architecture reviews, technical design documentation, and engineering best practices for AI platforms.
Required Skill
- Experience with Large Language Models (OpenAI, Azure OpenAI, Anthropic, Gemini, or equivalent).
- Strong understanding of prompt engineering, AI agent frameworks, and conversational AI systems.
- Experience building Agentic AI applications using Semantic Kernel, LangChain, LangGraph, AutoGen, CrewAI, or similar frameworks.
- Hands-on experience with MCP servers, tool integration, API orchestration, and enterprise system connectivity.
- Proficiency in Python, TypeScript, or similar programming languages.
- Familiarity with RAG architectures, vector databases, embeddings, and knowledge retrieval systems.
- Understanding of cloud platforms such as Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AI.
- Strong problem-solving, analytical, and collaboration skills.
Preferred Qualifications
- Experience building enterprise copilots, AI assistants, or autonomous agent ecosystems.
- Knowledge of AI governance, responsible AI, and security best practices.
- Experience integrating AI agents with healthcare, health records, or regulated industry systems
All your information will be kept confidential according to EEO guidelines.
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Principal Software Engineer leading frontend and full-stack architecture for Atlassian’s Growth Platform. The role defines technical strategy for messaging, personalization, notifications, and experimentation systems; designs scalable microservices, APIs, data models, and React/TypeScript components; drives performance, reliability, security, accessibility, observability, and CI/CD standards; and influences multiple teams through architecture reviews, cross-functional partnership, and mentorship.
Top Skills:
APIsAutomated TestingCi/CdClient SdksClient-Side State ManagementCore Web VitalsCSSData ModelingDistributed SystemsDistributed TracingHTML5Javascript Es6+MicroservicesObservabilityReactTelemetryTypescript
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Provides organization-wide technical leadership for Atlassian’s Dev AI platforms and autonomous developer initiatives. Defines multi-year architectures for agent runtimes, orchestration engines, execution sandboxes, memory systems, and context retrieval. Drives distributed-system architecture, reliability, security, responsible AI governance, evaluation, and operational standards. Leads cross-organizational technical initiatives, resolves architectural ambiguity, mentors senior engineers, partners with product and engineering leaders, and remains hands-on with strategic prototypes and architectural validation.
Top Skills:
Agent OrchestrationAi Evaluation FrameworksArtificial IntelligenceAtlassian Teamwork GraphAutonomous Ai AgentsBitbucketCode IntelligenceCode SynthesisDistributed SystemsJIRAResponsible AiRetrieval SystemsRuntime SandboxesSemantic SearchTelemetry
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead enterprise customer engagements to adopt and operationalize Atlassian’s Rovo AI platform. Facilitate discovery, design and configure AI agents and connectors, guide deployments from sandbox to production, and drive measurable adoption outcomes. Own engagement playbooks, enable internal teams, provide product feedback, and collaborate with sales, customer success, product, and engineering teams. The role involves supporting complex enterprise use cases, mentoring without direct authority, and up to 15% domestic and international travel.
Top Skills:
Agentic WorkflowsAi AgentsAtlassianConfluenceGitGoogle DriveJIRALlm-Powered ArchitecturesPrompt EngineeringRovoRovo StudioSharepointSlack
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
