EXL Logo

EXL

GenAI / Agentic Architect

Reposted One Month Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Lead enterprise GenAI strategy and architecture across the 7-layer LLM stack. Advise C-suite, design scalable ingestion and RAG/agentic pipelines, implement observability (token tracing, drift/hallucination monitoring), enforce data protection/DLP and semantic caching, and oversee large onshore client delivery and technology trade-off decisions.
The summary above was generated by AI

Direct the enterprise GenAI technology portfolio and lead large-scale, onshore client engagements. 

Act as a trusted senior technical architect and advisor to client leadership, bridging the gap between cutting-edge AI capabilities and core business transformation. 

Oversee multiple architectural delivery streams, making high-impact decisions on technology stacks, framework selection, and infrastructural trade-offs across the 7-layer AI stack.

Responsibilities
  • Enterprise AI Strategy & Trade-Off Analysis: Define multi-year GenAI roadmaps by evaluating structural architecture trade-offs across the 7-layer LLM stack. Compare Commercial APIs (e.g., GPT-4o, Claude 3.5 Sonnet) vs. Hosted Open-Source LLMs (e.g., Llama 3) based on cost, latency, and data privacy.
  • Advanced Architecture Oversight: Review and approve macro-level AI architectures. Architect scalable data ingestion pipelines, selecting between standard semantic RAG, Agentic RAG, or GraphRAG depending on enterprise complexity.
  • Advanced Observability & Monitoring: Design deeply integrated AI observability (OBS) layers tailored for LLMs. Implement specialized tools (e.g., LangSmith, Phoenix, Arize) to track token consumption, trace complex agentic reasoning loops, and monitor model drift and hallucination rates in production.
  • Robust Data Protection Strategy: Architect comprehensive data protection pipelines utilizing Enterprise Data Loss Prevention (DLP) tools. Ensure data is sanitized before hitting external APIs and implement robust semantic caching to prevent sensitive data leakage.
  • Executive Consulting & Technical Pitching: Lead onshore client-facing engagements, pitching complex AI solutions to C-suite stakeholders, translating engineering trade-offs into clear financial and operational ROI frameworks.
Qualifications
  • Consulting Skills: High-impact executive presence; extensive experience in technology consulting, solution scoping, and technical proposal architecture.
  • Senior Technical Architecture Mastery: Deep hands-on background in enterprise integration patterns. Expert-level capability in comparing orchestration layers (e.g., LangChain vs. LlamaIndex vs. Semantic Kernel) and evaluating modern execution environments (vLLM, TensorRT-LLM).
  • Cloud & Vector Strategy: Deep familiarity with dictating enterprise data storage choices by comparing managed vector services (Pinecone) vs. distributed open-source engines (Milvus/Qdrant) or extending existing relational systems (pgvector).
  • Qualifications: Master’s in computer science, AI, or IT Management; 12–18 years of progressive IT/AI experience, heavily indexing on senior technical architecture and client delivery.

The typical base pay range for this role across the U.S. is USD $200,000 - $280,000 per year.

For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits


The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale.

Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position.


The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.

Similar Jobs

An Hour Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Consulting
Leads enterprise Azure Virtual Desktop and Azure architecture engagements, advising executive stakeholders and translating business requirements into secure, scalable, cost-effective solutions. Defines AVD standards, reference architectures, roadmaps, capacity and cost optimization strategies, and implementation plans. Partners with sales, engineering, delivery, and operations teams throughout the architecture lifecycle while mentoring technical teams. Requires deep experience with Azure, AVD, identity, networking, infrastructure as code, automation, and enterprise EUC/VDI migrations.
Top Skills: Active DirectoryArm TemplatesAWSAzure ComputeAzure FilesAzure MonitorAzure Netapp FilesAzure PolicyAzure StorageAzure Virtual DesktopAzure Virtual NetworksBicepCi/CdCitrixFslogixGoogle Cloud PlatformLog AnalyticsAzureMicrosoft Defender For EndpointMicrosoft Entra IdMicrosoft IntuneNerdioPowershellRemote Desktop ServicesTerraformVmware Horizon
An Hour Ago
Easy Apply
Remote
United States
Easy Apply
160K-215K Annually
Senior level
160K-215K Annually
Senior level
Artificial Intelligence • Fintech • Software • Travel
Own the full lifecycle and growth of strategic channel partnerships across associations, fintech, marketplaces, and distribution platforms. Drive revenue and GBV through performance optimization, QBRs, commercial negotiations, partner enablement, tier progression, and expansion initiatives. Build playbooks, health scoring, and scalable channel infrastructure while translating partner needs into product requests and coordinating cross-functional issue resolution.
Top Skills: CrossbeamExcelGoogle Sheets
An Hour Ago
Remote or Hybrid
United States
56K-76K Annually
Junior
56K-76K Annually
Junior
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Own customer support cases for Ivans digital products from initial contact through resolution. Troubleshoot configuration, data, integration, API, and potential product issues; perform root-cause analysis; guide onboarding and setup; document recurring solutions; and collaborate with Product, Engineering, and integration partners. Translate technical findings into clear customer communication and well-documented escalations.
Top Skills: APIsIvans Digital ProductsSaaSStructured Data Formats

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account