Design and deliver GenAI solutions: prototype to production LLM services, build RAG pipelines, fine-tune models (LoRA/QLoRA/PEFT), engineer prompts/tools/memory, ensure safety and evaluation, deploy with MLOps (CI/CD, containers, IaC), optimize inference, and ensure security/compliance while collaborating with product, data, and SRE teams.
Key Responsibilities Solution Design and Delivery Translate business problems into Gen AI architectures (LLM, RAG, agentic patterns, multimodal). Build end-to-end prototypes and evolve them into reliable, secure production services. LLM Development Select and integrate foundation models (hosted APIs or open-source). Implement fine-tuning and parameter-efficient methods (e.g., LoRA/QLoRA/PEFT) where needed. Engineer prompts/system messages, tools/functions, and memory strategies. Retrieval and Data Implement RAG pipelines: chunking, embeddings, retrieval, re-ranking, and filtering. Work with vector databases and document stores; design data quality checks. Evaluation and Safety Define automated and human-in-the-loop evaluation for accuracy, toxicity, bias, and hallucinations. Implement guardrails, content filters, and policy enforcement. MLOps and Platform Package and deploy services with CI/CD, containerization, and IaC as applicable. Optimize inference for latency, throughput, and cost; monitor with observability tooling. Security, Privacy, and Compliance Handle PII securely; align with data governance, regulatory, and licensing constraints. Collaboration Partner with product, domain SMEs, data engineering, and SRE to deliver measurable outcomes. Document designs, decisions, and runbooks; share best practices.
Similar Jobs
Information Technology • Consulting
Design, develop, and maintain enterprise AI applications, including conversational assistants, copilots, autonomous agents, RAG solutions, and workflow automation. Build scalable APIs and microservices integrating foundation models and enterprise systems. Apply prompt and context engineering, memory management, observability, governance, and performance optimization. Collaborate with cross-functional teams to identify automation opportunities and participate in Agile development, code reviews, CI/CD, and DevSecOps.
Top Skills:
Agentic Ai FrameworksAmazon BedrockAmazon Q DeveloperCi/CdClaudeClaude CodeCloud-Native MessagingContext EngineeringDevsecopsGenerative AiGithub CopilotJavaScriptKafkaLarge Language Models (Llms)Microservices ArchitectureOpenaiPrompt EngineeringPythonReactRetrieval Augmented Generation (Rag)TypescriptVector Databases
Information Technology • Consulting
Design, build, and operate a secure, scalable enterprise Generative AI platform on AWS (including AWS Bedrock). Own platform lifecycle: architecture, deployment, operations, monitoring, incident management, reliability, and governance. Implement LLM inference, RAG, Agents, guardrails, observability, security controls, access management, compliance, and cost optimization. Support production-grade GenAI applications in regulated/financial environments.
Top Skills:
AgentsAWSAws BedrockLlmsMicroservicesPythonRest ApisRetrieval-Augmented Generation (Rag)
Information Technology • Consulting
Develop, test, and maintain applications using Java, Python, or Node.js. Write clean, efficient code, debug and optimize, collaborate with cross-functional teams, use data structures/algorithms, work with SQL/NoSQL databases, participate in code reviews, and stay current on AI/ML concepts, agents, and automation tools.
Top Skills:
AgentsAIAutomation ToolsJavaMachine LearningNode.jsNoSQLPythonSQL
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
