Leads the design, development, governance, and enterprise adoption of secure Generative AI platforms and applications. Responsibilities include architecting RAG and agent-based solutions, developing APIs and reusable frameworks, establishing evaluation and prompt engineering standards, ensuring security and responsible AI practices, mentoring engineers, influencing architecture, and driving technical strategy across teams.
Role Summary
Primary Responsibilities
Supervisory/Managerial Responsibilities
Education and Experience Required
Education and Experience Preferred
The Principal AI Platform Engineer serves as a senior technical authority responsible for designing, developing, and driving enterprise adoption of Generative AI capabilities within M&T Bank's secure, governed technology ecosystem. This role combines deep software engineering expertise, advanced AI platform knowledge, and strategic technical leadership to deliver scalable, resilient, and responsible AI solutions. The Principal AI Platform Engineer influences enterprise architecture, establishes engineering best practices, mentors technical talent, and partners with senior technology and business leaders to shape the future of AI-enabled capabilities across the organization.
Primary Responsibilities
- Design, develop, and support enterprise-scale GenAI solutions, including AI-assisted development, documentation, testing, analytics, and workflow automation capabilities.
- Lead the architecture, implementation, and optimization of Retrieval-Augmented Generation (RAG) solutions, including ingestion pipelines, embeddings, vector stores, retrieval frameworks, and search capabilities.
- Design, review, and approve agent-based and tool-integrated AI architectures, including multi-step LLM workflows using approved enterprise platforms and services.
- Develop and oversee APIs, shared services, and reusable frameworks that connect AI models to internal systems, platforms, and approved third-party tools.
- Establish prompt engineering standards, evaluation methodologies, and testing frameworks to continuously improve AI solution quality, reliability, safety, and performance.
- Drive model testing, benchmarking, evaluation, and performance analysis efforts utilizing enterprise-approved frameworks and governance standards.
- Author organized, secure, scalable, and maintainable code at the expert level using multiple programming languages, including Java, Python, and C#, while promoting engineering excellence across teams.
- Lead technical discussions with Product Managers, Architects, Engineers, and senior stakeholders to translate business objectives into enterprise-scale AI solutions.
- Serve as a subject matter expert for Generative AI, AI platform engineering, and responsible AI practices across Technology.
- Mentor and coach engineers on software engineering best practices, AI architecture patterns, algorithms, data structures, and enterprise platform design.
- Contribute to technical roadmaps that balance strategic AI initiatives, platform modernization, innovation, operational excellence, and technical debt reduction.
- Define and champion architecture standards, design patterns, and implementation guidance for AI-enabled solutions across multiple technology domains.
- Apply and analyze engineering, operational, and AI performance metrics to identify opportunities for process improvement, platform optimization, and increased adoption.
- Lead the implementation of resiliency, performance, observability, and security best practices within AI platforms and services.
- Drive adoption of responsible AI, model governance, security, compliance, privacy, and risk management standards throughout the AI development lifecycle.
- Participate in and present to enterprise architecture forums, engineering councils, and leadership committees while influencing AI strategy and technology direction.
- Understand and adhere to the Company's risk and regulatory standards, policies and controls in accordance with the Company's Risk Appetite. Identify risk-related issues needing escalation to management.
- Promote an environment that supports a culture of belonging and reflects the M&T Bank brand.
- Maintain M&T internal control standards, including timely implementation of internal and external audit points together with any issues raised by external regulators as applicable.
- Complete other related duties as assigned.
Supervisory/Managerial Responsibilities
No supervisory responsibilities.
Education and Experience Required
- Associate’s degree and a minimum of 9 years’ systems analysis and/ or application development work experience or Bachelor's degree and a minimum of 7 years' systems analysis and/ or application development work experience. In lieu of a degree, a combined minimum of 11 years’ education and/or relevant work experience, including a minimum of 7 years’ systems analysis and/ or application development work experience.
- Expert proficiency in a minimum of 1 relevant programming language and advanced proficiency in a minimum of 1 additional relevant programming language.
- Strong foundation in software engineering principles, data structures, algorithms, and distributed system design.
- Hands-on experience developing production applications using Java, Python, C#, or other modern enterprise programming languages.
- Experience designing and integrating RESTful APIs, microservices, and API-driven architectures.
- Advanced knowledge of Generative AI, Large Language Models (LLMs), prompt engineering, and AI application development.
- Experience building and supporting AI-enabled applications within enterprise SDLC, security, compliance, and governance frameworks.
- Proven ability to influence technical direction, engineering standards, and architectural decisions across multiple teams.
Education and Experience Preferred
- Experience implementing enterprise Generative AI solutions within financial services or other highly regulated industries.
- Deep expertise in Retrieval-Augmented Generation (RAG), embeddings, vector databases, retrieval frameworks, and semantic search technologies.
- Strong understanding of Transformer architectures, attention mechanisms, tokenization strategies, and model evaluation techniques.
- Experience designing AI agents, tool-integrated workflows, and advanced LLM orchestration frameworks.
- Expertise with Microsoft Azure, Azure AI Services, OpenAI technologies, and cloud-native AI platforms.
- Experience establishing enterprise AI governance, responsible AI practices, and model risk management controls.
- Experience leading large-scale technical initiatives, platform modernization efforts, or enterprise capability rollouts.
- Proven experience influencing senior technology and business stakeholders and driving enterprise-wide adoption of new technologies.
- Ability to work autonomously while leading complex technical initiatives across multiple teams.
- Advanced verbal and written communication skills with the ability to present complex technical concepts to executive audiences.
- Proven subject matter expertise in AI platform engineering, software architecture, and enterprise application development.
- Experience with CI/CD pipelines, DevOps tooling, automated testing, observability, and platform reliability engineering practices.
#LI-JB3
M&T Bank is committed to fair, competitive, and market-informed pay for our employees. The pay range for this position is $139,700.00 - $232,900.00 Annual (USD). The successful candidate’s particular combination of knowledge, skills, and experience will inform their specific compensation. The range listed above corresponds to our national pay range for this role. The specific pay range applicable to you may vary based on your location.LocationClanton, Alabama, United States of AmericaSimilar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Own the architecture and long-term evolution of hybrid, multi-tenant AI compute platforms across bare-metal OpenShift and public-cloud services. Define distributed training networking, GPU utilization and cost models, GitOps governance, model-serving standards, workload placement, identity and security controls, SLOs, disaster recovery, and platform upgrade strategies. Partner with AI, privacy, and security teams to deliver HIPAA-compliant infrastructure for training and inference workloads.
Top Skills:
Argo CdAws BedrockAzure Ai FoundryCephDcgmDeepspeedFsdpGcp Vertex AiGitopsGpudirect RdmaHipaaIbm Storage ScaleInfinibandJaxKserveKubeflow PipelinesKubernetesKueueLustreMigMtlsNcclNfdNvidia Gpu OperatorNvidia GpusNvlinkOauthOdfOidcOpenshift AiPytorch DdpRayRbacRed Hat OpenshiftRhacmRocev2Tensorrt-LlmVastVaultVllmVolcanoWeka
Healthtech
Own Matter Health’s AI platform strategy, architecture, governance, budget, and operations. Design secure tools and integrations for deploying AI agents and workflows, including MCP and RPA integrations. Establish development standards, monitoring, reliability, and incident-response practices while partnering with engineering, security, compliance, clinical, and operational teams. Evaluate vendors and platform investments, guide internal builders, resolve complex technical issues, and measure business impact in a regulated healthcare environment.
Top Skills:
Ai AgentsEnterprise Ai PlatformsIncident ResponseMcpMonitoringRpaSoftware PlatformsWorkflow Automation
Social Media
Architect the infrastructure powering Pinterest’s Generative AI and recommender systems at petabyte scale. Set the AI Platform’s technical vision and roadmap, lead cross-functional initiatives spanning data orchestration, model training, fine-tuning, evaluation, feature stores, and high-performance inference, and drive company-wide architecture decisions. Foster an inclusive engineering culture while maintaining high standards for quality, ownership, and accountability.
Top Skills:
Ai/Ml InfrastructureBatch InferenceC++Distributed SystemsFeature StoresGenerative AiJavaModel Fine-TuningModel TrainingMultimodal Data ManagementOnline InferenceRecommender SystemsRust
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center



