Design and implement AI capabilities, transition prototypes to production, build agent workflows, optimize data retrieval, and automate evaluation processes.
Description
At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. It's why we're coworkers, not just employees. Coworkers who genuinely believe in supporting our customers and one another. We collectively forge our path forward with a level of commitment that speaks to who we are and where we're headed. We're proud to share our story and Make Amazing Happen at CDW. At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. It's why we're coworkers, not just employees. Coworkers who genuinely believe in supporting our customers and one another. We collectively forge our path forward with a level of commitment that speaks to who we are and where we're headed. We're proud to share our story and Make Amazing Happen at CDW.
Job summary
We are seeking a Senior AI Engineer to transition our AI capabilities from "prototype" to "production." In this role, you will not just experiment with models; you will architect robust Agentic Systems that can plan, reason, and execute complex workflows autonomously for a wide variety of business user needs while experimenting with cutting-edge models and tools to push the boundaries of what's possible. The ideal candidate is a
* forward-thinking engineer
* who thrives on hands-on experimentation with AI models and frameworks, learns quickly, and is naturally curious. You will collaborate closely with product managers, business partners, and platform teams to deliver high-value AI agents that solve real-world problems across the enterprise
What you will do:
* Agentic Engineering & Orchestration
* Workflow Design:
* Architect complex, multi-agent workflows
* using Microsoft
* AI tech stack.
* Design
* , Develop and Deploy
* agents to handle loops, interruptions, and human-in-the-loop interventions.
* Tool Use & Function Calling:
* Build reliable "tool layers" that allow LLMs to safely interact with internal APIs, databases, and third-party SaaS platforms (e.g.,
* SalesF
* orce, Workday, ServiceNow etc.
* )
* State Management:
* Design persistence layers to manage agent memory, conversational history, and context windows efficiently.
* Advanced Data & RAG Strategy
* Retrieval Pipelines:
* Build production-grade
* data retrieval and integration
* systems. Optimize vector indexing, document chunking, and re-ranking algorithms to ensure high-precision context retrieval.
* Data Quality:
* Collaborate with Data Engineers to curate "Golden Datasets"
* for agent consumption
* LLMOps, Evaluation & Quality
* Automated Evaluation:
* Build CI/CD pipelines for AI that include
* "LLM-as-a-Judge"
* testing.
* Leverage
* frameworks to score agent outputs for accuracy, hallucination, and safety before deployment.
* Observability:
* Instrument applications with tracing tools to visualize agent reasoning chains, monitor latency, and debug failures in production.
* Cost Optimization:
* Monitor token usage and latency, optimizing prompt density and caching strategies to maintain high performance at sustainable costs.
* Innovation & Collaboration
* Prototyping to Production:
* Rapidly validate new ideas using state-of-the-art models
* then refactor successful prototypes into maintainable, tested production code.
* Standards Adoption:
* Stay ahead of the curve by evaluating emerging
* technologies
* to standardize agent connectivity.
What we expect of you
* Core Engineering: Bachelor's degree and 5 years of software engineering experience, with exposure to AI/ML applications OR 9 years of software engineering experience, with exposure to AI/ML applications
* AI Specialization: 2+ years specifically building with LLMs, with deep familiarity in:
* Orchestration: LangChain, LangGraph, or similar state-based frameworks.
* Vector DBs: Pinecone, Weaviate, or pgvector.
* Prompt Engineering: Advanced techniques (Chain-of-Thought, ReAct, Few-Shot).
* Production Mindset: Experience not just building demos, but operating them. You know how to handle rate limits, context window overflows, and non-deterministic errors.
* Soft Skills: Ability to explain "probabilistic software" to non-technical stakeholders- managing expectations that agents are never 100% accurate, but can be 100% useful.
* Excellent communication skills, with experience in documenting technical designs, sharing insights, and enabling team knowledge transfer.
* What We Offer
* Opportunity to design and build the next generation of enterprise AI agents.
* A collaborative environment where experimentation and innovation are encouraged.
* We make technology work so people can do great things.
* CDW is a leading multi-brand provider of information technology solutions to business, government, education and healthcare customers in the United States, the United Kingdom and Canada. A Fortune 500 company and member of the S&P 500 Index, CDW helps its customers to navigate an increasingly complex IT market and maximize return on their technology investments. Together, we unite. Together, we win. Together, we thrive. Pay range: $124,000 - $ 174,600 depending on experience and skill set Benefits overview: [https://cdw.benefit-info.com/](https://cdw.benefit-info.com/) Salary ranges may be subject to geographic differentials
* CDW is committed to being an AI-fluent organization
* We're looking for people who bring curiosity, a learner's mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances- not replaces- human creativity and decision-making. You don't need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that's curious, adaptive, and ready to explore what's possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.
* About Us
* CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what's possible through technology. What makes CDW different isn't just what we do- it's how we do it. At CDW we act as one- building trust, speaking candidly, and working together to achieve more. We play to win- focusing on what matters most and delivering for our customers. And we think forward- staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That's why we think of ourselves as coworkers, not just employees- working together to solve complex challenges and deliver real impact for our customers and communities. As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what's next. Together, we deliver the full promise of what technology can do.
* Together, we Make Amazing Happen.
* CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. It's why we're coworkers, not just employees. Coworkers who genuinely believe in supporting our customers and one another. We collectively forge our path forward with a level of commitment that speaks to who we are and where we're headed. We're proud to share our story and Make Amazing Happen at CDW. At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. It's why we're coworkers, not just employees. Coworkers who genuinely believe in supporting our customers and one another. We collectively forge our path forward with a level of commitment that speaks to who we are and where we're headed. We're proud to share our story and Make Amazing Happen at CDW.
Job summary
We are seeking a Senior AI Engineer to transition our AI capabilities from "prototype" to "production." In this role, you will not just experiment with models; you will architect robust Agentic Systems that can plan, reason, and execute complex workflows autonomously for a wide variety of business user needs while experimenting with cutting-edge models and tools to push the boundaries of what's possible. The ideal candidate is a
* forward-thinking engineer
* who thrives on hands-on experimentation with AI models and frameworks, learns quickly, and is naturally curious. You will collaborate closely with product managers, business partners, and platform teams to deliver high-value AI agents that solve real-world problems across the enterprise
What you will do:
* Agentic Engineering & Orchestration
* Workflow Design:
* Architect complex, multi-agent workflows
* using Microsoft
* AI tech stack.
* Design
* , Develop and Deploy
* agents to handle loops, interruptions, and human-in-the-loop interventions.
* Tool Use & Function Calling:
* Build reliable "tool layers" that allow LLMs to safely interact with internal APIs, databases, and third-party SaaS platforms (e.g.,
* SalesF
* orce, Workday, ServiceNow etc.
* )
* State Management:
* Design persistence layers to manage agent memory, conversational history, and context windows efficiently.
* Advanced Data & RAG Strategy
* Retrieval Pipelines:
* Build production-grade
* data retrieval and integration
* systems. Optimize vector indexing, document chunking, and re-ranking algorithms to ensure high-precision context retrieval.
* Data Quality:
* Collaborate with Data Engineers to curate "Golden Datasets"
* for agent consumption
* LLMOps, Evaluation & Quality
* Automated Evaluation:
* Build CI/CD pipelines for AI that include
* "LLM-as-a-Judge"
* testing.
* Leverage
* frameworks to score agent outputs for accuracy, hallucination, and safety before deployment.
* Observability:
* Instrument applications with tracing tools to visualize agent reasoning chains, monitor latency, and debug failures in production.
* Cost Optimization:
* Monitor token usage and latency, optimizing prompt density and caching strategies to maintain high performance at sustainable costs.
* Innovation & Collaboration
* Prototyping to Production:
* Rapidly validate new ideas using state-of-the-art models
* then refactor successful prototypes into maintainable, tested production code.
* Standards Adoption:
* Stay ahead of the curve by evaluating emerging
* technologies
* to standardize agent connectivity.
What we expect of you
* Core Engineering: Bachelor's degree and 5 years of software engineering experience, with exposure to AI/ML applications OR 9 years of software engineering experience, with exposure to AI/ML applications
* AI Specialization: 2+ years specifically building with LLMs, with deep familiarity in:
* Orchestration: LangChain, LangGraph, or similar state-based frameworks.
* Vector DBs: Pinecone, Weaviate, or pgvector.
* Prompt Engineering: Advanced techniques (Chain-of-Thought, ReAct, Few-Shot).
* Production Mindset: Experience not just building demos, but operating them. You know how to handle rate limits, context window overflows, and non-deterministic errors.
* Soft Skills: Ability to explain "probabilistic software" to non-technical stakeholders- managing expectations that agents are never 100% accurate, but can be 100% useful.
* Excellent communication skills, with experience in documenting technical designs, sharing insights, and enabling team knowledge transfer.
* What We Offer
* Opportunity to design and build the next generation of enterprise AI agents.
* A collaborative environment where experimentation and innovation are encouraged.
* We make technology work so people can do great things.
* CDW is a leading multi-brand provider of information technology solutions to business, government, education and healthcare customers in the United States, the United Kingdom and Canada. A Fortune 500 company and member of the S&P 500 Index, CDW helps its customers to navigate an increasingly complex IT market and maximize return on their technology investments. Together, we unite. Together, we win. Together, we thrive. Pay range: $124,000 - $ 174,600 depending on experience and skill set Benefits overview: [https://cdw.benefit-info.com/](https://cdw.benefit-info.com/) Salary ranges may be subject to geographic differentials
* CDW is committed to being an AI-fluent organization
* We're looking for people who bring curiosity, a learner's mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances- not replaces- human creativity and decision-making. You don't need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that's curious, adaptive, and ready to explore what's possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.
* About Us
* CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what's possible through technology. What makes CDW different isn't just what we do- it's how we do it. At CDW we act as one- building trust, speaking candidly, and working together to achieve more. We play to win- focusing on what matters most and delivering for our customers. And we think forward- staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That's why we think of ourselves as coworkers, not just employees- working together to solve complex challenges and deliver real impact for our customers and communities. As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what's next. Together, we deliver the full promise of what technology can do.
* Together, we Make Amazing Happen.
* CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
Top Skills
Langchain
Langgraph
Llms
Pgvector
Pinecone
Weaviate
CDW Austin, Texas, USA Office
10900 Stonelake Blvd Building 2 Suite 100 , Austin, TX, United States, 78759
Similar Jobs at CDW
Information Technology
The Managed Services Engineering Manager leads an engineering team, ensuring service delivery, customer satisfaction, and team development, while maintaining operational processes and financial goals.
Top Skills:
CiscoFive9IbmItilMicrosoftMicrosoft TeamsRingcentralVMwareWebexZoom
Information Technology
As a Campus Intern, you will enhance the technology experience at your University by liaising between CDW, University Administration, and IT departments, while developing communication skills and gaining hands-on experience in technology solutions.
Information Technology
Lead services-led, enterprise-level opportunity origination and sales for education accounts. Collaborate with account teams and architects to design outcome-based, multi-practice IT transformation solutions, engage C-suite stakeholders, and close complex engagements exceeding $1M while driving long-term customer partnerships.
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
