Hands-on Senior AI Engineer to design and ship production Generative AI systems: build RAG pipelines, embeddings, vector search, multi-agent orchestration, backend APIs (Python/Flask/FastAPI), deploy cloud-native workloads, implement LLMOps practices, and mentor through code reviews while owning end-to-end delivery.
We're looking for a hands-on AI Engineer who combines strong backend engineering fundamentals with hands-on experience building production Generative AI systems. You'll design and ship RAG pipelines, integrate LLMs into real products, and build the backend services that support them, writing code daily, not just architecting on paper.
This is a purely technical IC role, not a managerial one. You’ll lead by example, mentor through code reviews, and own end-to-end technical delivery.
Key Responsibilities
- Design and build RAG systems, embeddings, vector search, chunking, and evaluation pipelines.
- Build and maintain multi-agent orchestration workflows (LangGraph, AutoGen, CrewAI, or similar).
- Develop backend services and APIs (Python — Flask/FastAPI) that expose AI workflows to production systems.
- Deploy and scale AI workloads in cloud-native environments, using serverless or containerized patterns.
- Implement LLMOps practices: prompt versioning, cost tracking, monitoring, and evaluation.
- Write clean, tested code, and use AI-assisted tools (Copilot, Cursor, Claude Code) to move faster without cutting corners.
- Work with data and platform engineers to ship GenAI features quickly, from prototype to production.
Skills, Knowledge and Expertise
Must-Have Skills
- 5+ years of backend experience, with strong Python coding skills.
- Proven experience shipping RAG systems (vector DBs, embeddings, chunking).
- Familiarity with orchestration frameworks (LangGraph, LangChain, AutoGen, or similar).
- Experience with APIs, microservices, and cloud-native development (AWS preferred).
- Familiarity with distributed systems concepts (async, message queues, caching).
- Experience with unstructured data (PDFs, tables, images).
- Builder mindset: thrives on writing, debugging, and improving production code.
- Collaborative, humble, and open to feedback.
- Strong communicator who explains design decisions clearly.
Influences through contribution, not hierarchy.
About
Emumba is a global engineering and consulting company with strengths in software development and an established AWS cloud practice focused on Data and GenAI. For 15 years, our teams across the US, the UAE, and Pakistan have earned trust through quality delivery and ownership of work. We look for people who value the culture they work in as much as the craft they bring to it.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and deploy production AI/ML and generative-AI solutions (including RAG and agentic workflows) to enhance sales and distribution platforms. Develop scalable components, API integrations, microservices, and automation pipelines; monitor model performance; ensure Responsible AI, security, and enterprise governance; and collaborate with cross-functional and offshore teams to deliver reliable, high-performing systems.
Top Skills:
Agentic Workflow FrameworksApi IntegrationsGpt-Based ModelsMicroservicesMlopsRetrieval-Augmented Generation (Rag)
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, evaluate, and deploy AI/LLM-powered solutions (RAG, agents, classifiers, summarizers) for consumer-facing products. Develop prompt strategies, guardrails, and evaluation frameworks; partner with data engineering and cross-functional teams to ensure trusted data, observability, safety, and continuous improvement of model performance in production.
Top Skills:
Agent FrameworksData PipelinesEmbeddingsEvaluation ToolingLlmsModel ApisOrchestration FrameworksProduction Ai Monitoring ToolsPrompt EngineeringPythonRagVector Search
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Design and build scalable, automated evaluation pipelines and infrastructure to validate speech, audio, and multimodal models. Translate research benchmarks into enforceable pass/fail gates, run batch and streaming tests, operate canaries and continuous monitoring, integrate quality gates into CI/CD, and partner with research, training, inference, and infra teams to prevent regressions and ensure production model quality.
Top Skills:
Agent FrameworksAnomaly DetectionCi/CdContainersDockerGoGpu ClustersGrafanaKubernetesLlmsMultimodal ModelsPythonRagReact NativeRust
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
