Leads the design, development, governance, and enterprise adoption of secure Generative AI platforms and applications. Responsibilities include architecting RAG and agent-based solutions, developing APIs and reusable frameworks, establishing evaluation and prompt engineering standards, ensuring security and responsible AI practices, mentoring engineers, influencing architecture, and driving technical strategy across teams.
Role Summary
Primary Responsibilities
Supervisory/Managerial Responsibilities
Education and Experience Required
Education and Experience Preferred
The Principal AI Platform Engineer serves as a senior technical authority responsible for designing, developing, and driving enterprise adoption of Generative AI capabilities within M&T Bank's secure, governed technology ecosystem. This role combines deep software engineering expertise, advanced AI platform knowledge, and strategic technical leadership to deliver scalable, resilient, and responsible AI solutions. The Principal AI Platform Engineer influences enterprise architecture, establishes engineering best practices, mentors technical talent, and partners with senior technology and business leaders to shape the future of AI-enabled capabilities across the organization.
Primary Responsibilities
- Design, develop, and support enterprise-scale GenAI solutions, including AI-assisted development, documentation, testing, analytics, and workflow automation capabilities.
- Lead the architecture, implementation, and optimization of Retrieval-Augmented Generation (RAG) solutions, including ingestion pipelines, embeddings, vector stores, retrieval frameworks, and search capabilities.
- Design, review, and approve agent-based and tool-integrated AI architectures, including multi-step LLM workflows using approved enterprise platforms and services.
- Develop and oversee APIs, shared services, and reusable frameworks that connect AI models to internal systems, platforms, and approved third-party tools.
- Establish prompt engineering standards, evaluation methodologies, and testing frameworks to continuously improve AI solution quality, reliability, safety, and performance.
- Drive model testing, benchmarking, evaluation, and performance analysis efforts utilizing enterprise-approved frameworks and governance standards.
- Author organized, secure, scalable, and maintainable code at the expert level using multiple programming languages, including Java, Python, and C#, while promoting engineering excellence across teams.
- Lead technical discussions with Product Managers, Architects, Engineers, and senior stakeholders to translate business objectives into enterprise-scale AI solutions.
- Serve as a subject matter expert for Generative AI, AI platform engineering, and responsible AI practices across Technology.
- Mentor and coach engineers on software engineering best practices, AI architecture patterns, algorithms, data structures, and enterprise platform design.
- Contribute to technical roadmaps that balance strategic AI initiatives, platform modernization, innovation, operational excellence, and technical debt reduction.
- Define and champion architecture standards, design patterns, and implementation guidance for AI-enabled solutions across multiple technology domains.
- Apply and analyze engineering, operational, and AI performance metrics to identify opportunities for process improvement, platform optimization, and increased adoption.
- Lead the implementation of resiliency, performance, observability, and security best practices within AI platforms and services.
- Drive adoption of responsible AI, model governance, security, compliance, privacy, and risk management standards throughout the AI development lifecycle.
- Participate in and present to enterprise architecture forums, engineering councils, and leadership committees while influencing AI strategy and technology direction.
- Understand and adhere to the Company's risk and regulatory standards, policies and controls in accordance with the Company's Risk Appetite. Identify risk-related issues needing escalation to management.
- Promote an environment that supports a culture of belonging and reflects the M&T Bank brand.
- Maintain M&T internal control standards, including timely implementation of internal and external audit points together with any issues raised by external regulators as applicable.
- Complete other related duties as assigned.
Supervisory/Managerial Responsibilities
No supervisory responsibilities.
Education and Experience Required
- Associate’s degree and a minimum of 9 years’ systems analysis and/ or application development work experience or Bachelor's degree and a minimum of 7 years' systems analysis and/ or application development work experience. In lieu of a degree, a combined minimum of 11 years’ education and/or relevant work experience, including a minimum of 7 years’ systems analysis and/ or application development work experience.
- Expert proficiency in a minimum of 1 relevant programming language and advanced proficiency in a minimum of 1 additional relevant programming language.
- Strong foundation in software engineering principles, data structures, algorithms, and distributed system design.
- Hands-on experience developing production applications using Java, Python, C#, or other modern enterprise programming languages.
- Experience designing and integrating RESTful APIs, microservices, and API-driven architectures.
- Advanced knowledge of Generative AI, Large Language Models (LLMs), prompt engineering, and AI application development.
- Experience building and supporting AI-enabled applications within enterprise SDLC, security, compliance, and governance frameworks.
- Proven ability to influence technical direction, engineering standards, and architectural decisions across multiple teams.
Education and Experience Preferred
- Experience implementing enterprise Generative AI solutions within financial services or other highly regulated industries.
- Deep expertise in Retrieval-Augmented Generation (RAG), embeddings, vector databases, retrieval frameworks, and semantic search technologies.
- Strong understanding of Transformer architectures, attention mechanisms, tokenization strategies, and model evaluation techniques.
- Experience designing AI agents, tool-integrated workflows, and advanced LLM orchestration frameworks.
- Expertise with Microsoft Azure, Azure AI Services, OpenAI technologies, and cloud-native AI platforms.
- Experience establishing enterprise AI governance, responsible AI practices, and model risk management controls.
- Experience leading large-scale technical initiatives, platform modernization efforts, or enterprise capability rollouts.
- Proven experience influencing senior technology and business stakeholders and driving enterprise-wide adoption of new technologies.
- Ability to work autonomously while leading complex technical initiatives across multiple teams.
- Advanced verbal and written communication skills with the ability to present complex technical concepts to executive audiences.
- Proven subject matter expertise in AI platform engineering, software architecture, and enterprise application development.
- Experience with CI/CD pipelines, DevOps tooling, automated testing, observability, and platform reliability engineering practices.
#LI-JB3
M&T Bank is committed to fair, competitive, and market-informed pay for our employees. The pay range for this position is $139,700.00 - $232,900.00 Annual (USD). The successful candidate’s particular combination of knowledge, skills, and experience will inform their specific compensation. The range listed above corresponds to our national pay range for this role. The specific pay range applicable to you may vary based on your location.LocationClanton, Alabama, United States of AmericaM&T Bank Oakland, California, USA Office
Oakland, United States
Similar Jobs
AdTech • Marketing Tech
Lead the expansion of Snowplow’s Firn applied AI platform, initially focused on go-to-market intelligence. Design and productionize platform services, agents, tools, MCP and LLM gateways, tracing, evaluation infrastructure, learning loops, and data integrations. Establish engineering standards for reliability, observability, cost management, documentation, and recovery while setting the technical roadmap and guiding platform architecture. Collaborate with data engineers and nontechnical internal customers, and own services as they transition into production.
Top Skills:
Ci/CdCloud InfrastructureDbtLlm GatewaysMcpPythonSnowflakeSQLTypescript
Software
Build and operate a secure, locally hosted LLM platform for enterprise engineering and business use. Responsibilities include model evaluation and optimization, inference serving, RAG and search pipelines, permission-aware retrieval, security controls, evaluation frameworks, observability, safe agent tooling, integrations, CI/CD, reliability, and lifecycle management. The role leads architecture and roadmap decisions while partnering cross-functionally to deliver measurable, production-ready generative AI capabilities.
Top Skills:
Active DirectoryAmd GpusApi SecurityCC++Ci/CdCudaDockerEmbeddingsEncryptionExperiment RegistriesGitGoHybrid SearchInfrastructure As CodeJavaKserveKubernetesLarge Language ModelsLexical SearchLinuxLlama.CppLoraModel RegistriesNvidia GpusObservabilityPythonQloraRagRay ServeRbacRerankingRocmSecrets ManagementSglangSsoTensorrt-LlmTransformer ModelsTritonVector DatabasesVllm
Insurance
Build and operate PEMCO’s end-to-end AI platform, including GPU infrastructure, model serving, AI gateways, retrieval systems, agent orchestration, observability, evaluation, cost telemetry, security, and governance. Lead production deployment, monitoring, incident response, lifecycle management, and architecture standards for AI systems. Optimize model routing, costs, performance, and reliability across Azure and potential on-premises environments while influencing organization-wide AI platform and governance decisions.
Top Skills:
Ai FoundryArizeAzureAzure Api ManagementAzure Gpu VmsAzure Kubernetes Service (Aks)Azure OpenaiCudaEmbedding PipelinesGpu SchedulingKubernetesLangchainLangfuseLanggraphLangsmithLitellmLoraMcpNvidia TritonRagRbacSemantic KernelTensorrt-LlmVector StoresVllm
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
