Lead the design, development, and deployment of production-grade AI applications, including LLM workflows, RAG systems, and agentic solutions. Establish AI engineering standards, architecture practices, observability, governance, security, and risk controls. Build automation and secure Python services, evaluate vendors and emerging technologies, and partner across product, engineering, legal, and risk teams. Mentor teams through documentation, workshops, and technical reviews while delivering reliable, scalable, cost-effective AI capabilities.
Job Responsibilities
- Enhance multiple products across the product line by identifying, prioritizing, and delivering AI-driven features that improve user experience, efficiency, and operational resilience
- Design, build, and deploy production-grade AI applications including LLM-powered workflows, Retrieval-Augmented Generation (RAG) solutions, and agentic systems
- Build agentic workflows with enterprise-ready controls (identity, authorization, guardrails, tracing, evaluation, and auditability)
- Develop automation solutions that reduce manual effort and eliminate recurring operational issues, including self-healing patterns and intelligent triage
- Architect AI systems with production concerns in mind: latency, scalability, cost management, model selection, observability, reliability, and failure modes (including hallucinations and tool errors)
- Establish and apply AI engineering standards across the product line (prompting patterns, RAG design standards, evaluation practices, logging/telemetry, and release readiness criteria)
- Drive AI architecture reviews and contribute to reference architectures for model hosting, orchestration, data access, and secure tool execution
- Identify and mitigate risks across the AI lifecycle including data privacy, security, bias, model misuse, prompt injection, and third-party/vendor risk, and ensure appropriate documentation and controls
- Partner with product, design, risk, legal/compliance, and engineering stakeholders to align on outcomes, constraints, and measurable success metrics
- Lead technical evaluations with vendors and platform providers; assess capabilities, integration fit, security posture, and total cost of ownership
- Research emerging AI capabilities (models, frameworks, tools) and translate findings into practical guidance, prototypes, and adoption recommendations
- Educate and enable teams through documentation, workshops, design reviews, and coaching to raise AI fluency and delivery consistency across the organization
- Execute creative software solutions, technical troubleshooting, and hands-on development; write secure, high-quality production code and review/debug code written by others
- Influence stakeholders and drive alignment across teams without direct authority, owning outcomes end-to-end
Required Qualifications, Capabilities, and Skills
- Formal training or certification in software engineering concepts and 5+ years of applied engineering experience
- Hands-on experience delivering AI-powered features in production or near-production environments (LLMs, RAG, agents, workflow automation, or decision support systems)
- Strong proficiency in Python (and ability to build maintainable services, libraries, and pipelines)
- Experience building APIs and services using Django, FastAPI, or similar frameworks
- Experience building modern UIs using React or similar frameworks (or strong ability to partner closely with frontend teams)
- Strong system design skills with an emphasis on secure distributed systems, reliability, and operational excellence
- Practical understanding of Responsible AI / model risk concepts (evaluation, guardrails, privacy, bias, explainability where applicable, and safe deployment practices)
- Experience implementing observability (logging, metrics, tracing) and AI-specific monitoring (quality, drift signals, latency, cost, error rates)
- Experience with cloud platforms (AWS preferred) and containerized deployments
- Strong problem-solving skills with a structured, evidence-based approach; comfortable operating in ambiguity and delivering iteratively
Preferred Qualifications, Capabilities, and Skills
- Experience with AI orchestration and agent frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel, CrewAI, or similar)
- Experience with vector search and retrieval patterns including pgvector, Pinecone, Weaviate, OpenSearch/Elastic, or similar
- Experience designing and operating RAG systems (chunking strategies, retrieval evaluation, citation/attribution patterns, caching, fallback behaviors)
- Familiarity with AI governance and standards (model documentation, risk assessments, control frameworks, secure-by-design patterns) and applying them to real delivery timelines
- Strong Infrastructure-as-Code experience (e.g., Terraform) and CI/CD practice, data engineering ecosystems (e.g., Databricks, streaming, data quality controls, lineage concepts)
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
Similar Jobs
Financial Services
Lead end-to-end delivery of cloud-native, full-stack software initiatives, defining architecture, engineering standards, reliability practices, observability, CI/CD, and secure production operations. Build microservices, APIs, and AI capabilities using LLMs and generative AI. Guide responsible AI-assisted development, lead incident response and continuous improvement, mentor engineers, and align technical priorities across stakeholders and initiatives.
Top Skills:
AWSCi/CdClaudeDistributed SystemsDockerGenerative AiGithub CopilotJavaKubernetesLarge Language Models (Llms)MicroservicesObservabilityPythonRest ApisRetrieval-Augmented Generation (Rag)
Financial Services
Leads design and development of scalable agentic AI solutions using Java and/or Python. Builds LLM-powered systems, MCP servers, APIs, production services, and cloud infrastructure on AWS. Establishes secure coding, testing, observability, reliability, and responsible AI practices. Guides team adoption of approved AI-assisted development tools, validates AI-generated outputs, and collaborates across product, design, and operations teams to deliver compliant enterprise applications.
Top Skills:
Agentic AiAWSAws CodebuildCloudwatchDockerEcsEksFastapiFlaskGithub ActionsGrafanaGrpcJavaJenkinsLlmsMcpOpenapiOpentelemetryPrometheusPythonRagRestSlmsSplunkSpring AiSpring BootSpring CloudSpring Security
Financial Services
Build and lead production Python software for technology-risk oversight, including data pipelines, PostgreSQL systems, authenticated APIs, and LLM agent workflows. Develop RAG, tool orchestration, evaluation, and guardrails; ensure security, auditability, observability, testing, reliability, and responsible AI use. Collaborate with Product, Risk, Controls, Compliance, and data teams while delivering dashboards and evidence packages.
Top Skills:
Chart.JsCi/CdCSSDatabricksGenerative AiGitHTMLJavaScriptKerberosLlmsMcpPostgresPytestPythonRagRest ApisSparkSQLSsoTlsWebsocket
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
