EXL Logo

EXL

GenAI / Agentic Architect

Reposted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Lead enterprise GenAI strategy and architecture across the 7-layer LLM stack. Advise C-suite, design scalable ingestion and RAG/agentic pipelines, implement observability (token tracing, drift/hallucination monitoring), enforce data protection/DLP and semantic caching, and oversee large onshore client delivery and technology trade-off decisions.
The summary above was generated by AI

Direct the enterprise GenAI technology portfolio and lead large-scale, onshore client engagements. 

Act as a trusted senior technical architect and advisor to client leadership, bridging the gap between cutting-edge AI capabilities and core business transformation. 

Oversee multiple architectural delivery streams, making high-impact decisions on technology stacks, framework selection, and infrastructural trade-offs across the 7-layer AI stack.

Responsibilities
  • Enterprise AI Strategy & Trade-Off Analysis: Define multi-year GenAI roadmaps by evaluating structural architecture trade-offs across the 7-layer LLM stack. Compare Commercial APIs (e.g., GPT-4o, Claude 3.5 Sonnet) vs. Hosted Open-Source LLMs (e.g., Llama 3) based on cost, latency, and data privacy.
  • Advanced Architecture Oversight: Review and approve macro-level AI architectures. Architect scalable data ingestion pipelines, selecting between standard semantic RAG, Agentic RAG, or GraphRAG depending on enterprise complexity.
  • Advanced Observability & Monitoring: Design deeply integrated AI observability (OBS) layers tailored for LLMs. Implement specialized tools (e.g., LangSmith, Phoenix, Arize) to track token consumption, trace complex agentic reasoning loops, and monitor model drift and hallucination rates in production.
  • Robust Data Protection Strategy: Architect comprehensive data protection pipelines utilizing Enterprise Data Loss Prevention (DLP) tools. Ensure data is sanitized before hitting external APIs and implement robust semantic caching to prevent sensitive data leakage.
  • Executive Consulting & Technical Pitching: Lead onshore client-facing engagements, pitching complex AI solutions to C-suite stakeholders, translating engineering trade-offs into clear financial and operational ROI frameworks.
Qualifications
  • Consulting Skills: High-impact executive presence; extensive experience in technology consulting, solution scoping, and technical proposal architecture.
  • Senior Technical Architecture Mastery: Deep hands-on background in enterprise integration patterns. Expert-level capability in comparing orchestration layers (e.g., LangChain vs. LlamaIndex vs. Semantic Kernel) and evaluating modern execution environments (vLLM, TensorRT-LLM).
  • Cloud & Vector Strategy: Deep familiarity with dictating enterprise data storage choices by comparing managed vector services (Pinecone) vs. distributed open-source engines (Milvus/Qdrant) or extending existing relational systems (pgvector).
  • Qualifications: Master’s in computer science, AI, or IT Management; 12–18 years of progressive IT/AI experience, heavily indexing on senior technical architecture and client delivery.

The typical base pay range for this role across the U.S. is USD $200,000 - $280,000 per year.

For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits


The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale.

Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position.


The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.

Similar Jobs

4 Minutes Ago
Remote or Hybrid
VT, USA
67K-101K Annually
Junior
67K-101K Annually
Junior
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Provides employee relations guidance to leaders on disciplinary actions, performance improvement plans, terminations, policy compliance, and workplace investigations. Manages cases through Workday, ServiceNow, and ethics systems; partners with HR, Legal, and business leaders; analyzes trends; supports legal information gathering; and promotes consistent, equitable employee relations practices. The role is fully remote for candidates in U.S. Eastern or Central time zones, with travel up to 25%.
Top Skills: ClaudeMicrosoft CopilotExcelMS OfficeMicrosoft PowerpointMicrosoft WordServicenowWorkday
4 Minutes Ago
Remote or Hybrid
67K-101K Annually
Junior
67K-101K Annually
Junior
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Provides employee relations guidance to business leaders on discipline, performance improvement plans, terminations, policy compliance, and less complex investigations. Manages employee relations cases, partners with HR, Legal, and leadership, analyzes trends, supports legal information gathering, and promotes consistent issue resolution. The role is fully remote for candidates in U.S. Eastern or Central time zones, with travel up to 25%.
Top Skills: ExcelMS OfficeMicrosoft PowerpointMicrosoft WordServicenowWorkday
4 Minutes Ago
Remote or Hybrid
GA, USA
67K-101K Annually
Junior
67K-101K Annually
Junior
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Provides employee relations guidance to business leaders on disciplinary actions, performance improvement plans, terminations, investigations, compliance, and conflict resolution. Manages employee relations cases, analyzes trends, partners with HR, Legal, and leadership, and supports consistent policy application. The role is fully remote for candidates in Eastern or Central U.S. time zones, with travel up to 25% as needed.
Top Skills: ClaudeMicrosoft CopilotExcelMS OfficeMicrosoft PowerpointMicrosoft WordServicenowWorkday

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account