Ontrac Solutions Logo

Ontrac Solutions

Principal AI Engineer

Reposted One Month Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
100K-120K Annually
Senior level
In-Office
San Francisco, CA, USA
100K-120K Annually
Senior level
Lead design and productionization of enterprise-grade Generative AI for banking. Own GenAI architecture (RAG, agents, prompt orchestration), ensure scalability, security, observability, and compliance. Partner with business, product, risk, cyber, legal, and platform teams to deliver regulated use cases, mentor engineers, establish reusable patterns, and embed governance, privacy, and guardrails into AI solutions.
The summary above was generated by AI
Overview

We are seeking a Principal GenAI Architect / Forward Deployed Principal Engineer to lead the design, delivery, and productionization of enterprise-grade Generative AI solutions within a highly regulated banking environment. This role will partner directly with business, product, engineering, architecture, risk, cyber, legal, compliance, and model governance teams to translate high-impact financial services use cases into scalable, secure, and compliant AI systems.

The ideal candidate has deep experience designing and delivering production-scale GenAI solutions across enterprise environments, with strong exposure to banking, financial services, risk management, customer operations, regulatory controls, and data protection requirements. This person will serve as a recognized GenAI expert across the organization, helping define reusable patterns, influence platform roadmaps, and raise the technical bar for responsible AI adoption across lines of business.

Key ResponsibilitiesGenAI Architecture & Production Readiness

Own and define enterprise-grade GenAI architectures for banking and financial services use cases, including RAG pipelines, agentic workflows, prompt orchestration, and multi-model routing strategies.

Drive production readiness for GenAI solutions, ensuring scalability, resiliency, observability, latency optimization, security, and cost efficiency.

Lead complex architectural decisions across data ingestion, vector databases, model selection, guardrails, API scalability, performance optimization, and secure integration with banking systems.

Establish reference architectures, reusable patterns, and best practices to accelerate responsible GenAI adoption across lines of business.

Partner with central AI platform teams to align solution architecture with enterprise AI services, platform capabilities, banking technology standards, and long-term roadmap priorities.

Banking Use-Case Delivery

Act as a Forward Deployed Principal Engineer, partnering directly with business, product, and engineering teams to deliver high-impact GenAI use cases from ideation through production.

Translate banking and financial services business problems into clear AI system designs, technical requirements, and non-functional requirements with measurable outcomes.

Support GenAI use cases across areas such as customer service, operations, knowledge management, risk, compliance, fraud, employee productivity, document intelligence, and internal workflow automation.

Troubleshoot and resolve complex issues across non-production and production environments.

Partner closely with application teams to ensure AI solutions integrate effectively into existing banking platforms, enterprise workflows, data environments, APIs, and control frameworks.

Influence platform roadmap by feeding real-world banking use-case requirements back into central AI services and enterprise AI platform teams.

Governance, Risk & Compliance

Ensure all AI solutions align with banking risk, cyber, model governance, data protection, privacy, and regulatory expectations.

Partner with Cyber, Model Risk Management, Legal, Compliance, Risk, and Data Governance teams to design compliant AI patterns without slowing delivery.

Embed security, privacy, responsible AI, ethical AI, explainability, human oversight, and auditability into solution design by default.

Help define practical implementation patterns that balance innovation, speed, governance, regulatory expectations, and enterprise control requirements.

Ensure GenAI solutions are designed with appropriate guardrails for sensitive financial data, customer information, personally identifiable information, and regulated business processes.

Organizational Influence & Mentorship

Serve as a recognized GenAI expert across the enterprise, regularly consulted by engineering, architecture, product, risk, compliance, and leadership teams.

Mentor senior and staff-level engineers and help raise the technical bar across banking technology teams.

Contribute to internal communities of practice, architecture reviews, executive-level technical discussions, AI governance forums, and knowledge-sharing sessions.

Represent enterprise GenAI capabilities in internal innovation forums, banking technology discussions, and responsible AI showcases.

Required Qualifications

7+ years of software engineering experience, with significant depth in AI/ML, data-intensive systems, distributed systems, or enterprise-scale platforms.

2+ years of hands-on Python programming experience.

2+ years of experience designing and delivering production-scale Generative AI systems in an enterprise environment.

2+ years of experience with LLMs, prompt engineering, and RAG architecture.

2+ years of experience with vector databases, semantic search, and retrieval systems.

2+ years of experience with API-driven, cloud-native architectures.

2+ years of experience with distributed systems, performance optimization, scalability, and reliability engineering.

Experience working within banking, financial services, fintech, or another highly regulated enterprise environment.

Preferred Qualifications

Strong understanding of banking technology environments and non-functional requirements, including security, scalability, resiliency, observability, latency, auditability, and cost management.

Demonstrated Principal-level impact, with influence across multiple teams, platforms, business units, or lines of business.

Experience operating in highly regulated environments, with financial services or banking experience strongly preferred.

Hands-on experience with agentic AI frameworks, AI workflow orchestration, and multi-model routing.

Prior experience in a Forward Deployed Engineer, embedded engineering, or business-facing technical delivery model.

Experience partnering with risk, cyber, legal, compliance, data governance, or model governance teams to deliver production AI solutions.

Familiarity with banking controls, customer data protection, model risk management, audit requirements, regulatory expectations, and responsible AI principles.

Ability to communicate complex technical concepts clearly to senior executives, technical stakeholders, risk partners, compliance teams, and non-technical business leaders.

Ideal Candidate Profile

The ideal candidate is a hands-on Principal-level engineer and architect who can move seamlessly between strategy, architecture, and execution in a banking environment. They are comfortable working directly with business teams to understand real-world financial services problems, while also going deep with engineering teams on system design, performance, security, governance, and production readiness.

This person brings strong technical judgment, enterprise banking delivery experience, and the ability to build practical, compliant GenAI solutions that can scale responsibly across a large financial institution.

Similar Jobs

4 Days Ago
Hybrid
Santa Clara, CA, USA
221K-387K Annually
Expert/Leader
221K-387K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead customer-facing design, deployment, and operation of agentic AI solutions on the ServiceNow platform. Analyze customer use cases, architect integrations and guardrails, validate reliability and safety, and guide production deployments. Establish reusable technical standards, reference architectures, and deployment patterns for the Forward Deployed Engineering group. Mentor engineers, advise customer stakeholders, and relay field insights to product and engineering teams.
Top Skills: Agentic AiCpqCRMLarge Language Models (Llms)Machine LearningMonitoringRollback SystemsServicenowSystem Integrations
5 Days Ago
In-Office or Remote
San Francisco, CA, USA
230K-288K Annually
Expert/Leader
230K-288K Annually
Expert/Leader
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead DigitalOcean’s AI security strategy, governance framework, roadmap, and organizational programs. Build and operationalize AI/ML security controls, tooling, guardrails, and automation; conduct threat modeling, adversarial testing, and AI red teaming. Review AI architectures, guide high-risk product decisions, monitor deployed models, and address risks involving RAG, agents, model supply chains, and prompt injection. Represent AI security to executives and external communities while translating emerging research and threats into engineering guidance and policy.
Top Skills: Agentic Ai FrameworksAi/MlEu Ai ActGoIso/Iec 42001Mitre AtlasModel ApisNist Ai RmfOwasp Llm Top 10PythonRag
9 Days Ago
Remote or Hybrid
Mountain View, CA, USA
Entry level
Entry level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Lead end-to-end machine learning development for autonomous driving, including data curation, foundation-model pre-training, post-training, fine-tuning, alignment, and deployment. Build scalable pipelines using real and synthetic datasets, apply imitation and reinforcement learning, improve model safety and reliability, collaborate across teams, lead technical initiatives, and mentor ML engineers.
Top Skills: SparkNumpyPandasPythonPyTorch

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account