Lead architecture and delivery of AI-first, agentic systems: design LLM integrations, RAG pipelines, multi-agent workflows, Python-based scalable backends, distributed event-driven microservices, and cloud-native solutions; ensure performance, security, cost optimization, and provide technical leadership across engineering and product teams.
Principal Architect – AI / LLM / Agentic Systems
Experience: 12–18 Years
Location: US (Remote/Hybrid)
Role Overview
We are looking for a Principal Architect to lead the design and delivery of AI-first, agentic, and distributed systems. This role requires deep expertise in Python-based architectures, LLM integrations, and cloud-native systems, with the ability to translate complex business problems into scalable, intelligent solutions.
You will define architecture strategy, guide engineering teams, and drive end-to-end solutioning for AI-powered platforms.
Key Responsibilities
- Define and drive architecture for AI/LLM-powered systems and agentic workflows
- Design RAG pipelines, multi-agent systems, and intelligent orchestration layers
- Architect scalable backend systems using Python
- Build and guide implementation of distributed, event-driven architectures
- Lead cloud-native solution design (AWS / Azure / GCP)
- Define system integration patterns across APIs, microservices, and AI services
- Ensure performance, scalability, security, and cost optimization
- Provide technical leadership, mentoring, and architectural governance
- Collaborate with product and business teams to shape solution strategy
Must-Have Qualifications
- 12+ years of experience in architecture / senior engineering roles
- Strong expertise in Python-based system design and development
- Hands-on experience with LLMs, RAG architectures, and AI integrations
- Experience building agentic systems / multi-agent architectures
- Strong understanding of distributed systems and microservices architecture
- Experience with cloud platforms (AWS / Azure / GCP)
- Expertise in API design, system integration, and scalable backend architectures
- Strong problem-solving, system design, and architectural decision-making skills
Good-to-Have
- Experience with frameworks like LangChain or LlamaIndex
- Exposure to Model Context Protocol (MCP) or similar agent frameworks
- Experience with Vector Databases (FAISS, Pinecone, Weaviate)
- Knowledge of streaming systems (Kafka, event-driven pipelines)
- Experience with DevOps, CI/CD, and platform engineering
What Makes This Role Unique
- Opportunity to architect next-gen AI-first platforms and agentic systems
- High ownership in defining enterprise-scale AI architecture strategy
- Blend of deep tech (AI + distributed systems) and business impact
- Work on cutting-edge GenAI use cases in production environments
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead HL7 FHIR interoperability efforts including selecting and coordinating Connectathon tracks, prepping teams and test environments, facilitating on-site testing, providing hands-on FHIR technical guidance (CDS Hooks, SMART, Bulk Data), mapping legacy data to FHIR, partnering with security/DevOps, and translating results into actionable roadmaps and standards updates.
Top Skills:
Api GatewaysCds HooksCi/CdDevops/SreFhir Bulk DataFhir ServersFlat FhirHipaaHl7 FhirIcd-10LoincNdjsonOauth 2.0ObservabilityPostmanRestful ApisSandboxSecure SdlcSmart App LaunchSnomed-CtThreat ModelingTouchstoneZero-Trust
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead design and implementation of enterprise-scale AI/ML solutions, define AI architecture roadmap, design end-to-end ML pipelines and MLOps, evaluate platforms (LLMs, RAG, vector DBs), ensure responsible AI and regulatory compliance, mentor teams, and represent AI architecture in leadership forums.
Top Skills:
Agent FrameworksAWSAzureBatch ProcessingCi/Cd For MlData PipelinesDrift DetectionGCPHipaaHugging FaceLangchainLlmsMlopsModel MonitoringPythonPyTorchRag PipelinesReal-Time ProcessingScikit-LearnSoc2TensorFlowVector Databases
Big Data • Information Technology • Productivity • Software • Analytics • Business Intelligence • Consulting
Design and lead enterprise solution and data architectures for large accounts, engage C-level stakeholders, unblock technical sales, guide integrations, cloud strategy, automation, and coach consulting teams to drive adoption, retention, and revenue.
Top Skills:
Agentic AiApi EcosystemsAWSAzureCase Centric Data PipelinesCelonisCloud Native ArchitecturesDynamics CrmEsbETLGCPInformaticaMulesoftOcpmOracleProcess Intelligence GraphProcess MiningPythonSaaSSalesforceSAPServicenowSQLTalend
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
