Lead design, development, and production deployment of LLM-powered applications, RAG pipelines, agentic workflows, and evaluation/monitoring systems. Collaborate cross-functionally to translate business needs into scalable, secure AI services and mentor engineering teams while enforcing responsible AI practices and production-grade MLOps.
Company Description
On-Site
1yr contract
$10950/month
About the Role
We are seeking a Senior Generative AI Engineer to design, build, and deploy production-grade AI applications powered by large language models (LLMs). In this role, you will lead the end-to-end development of Generative AI solutions, including LLM-powered applications, retrieval-augmented generation (RAG) systems, agentic workflows, model evaluation pipelines, and production infrastructure.
You will work cross-functionally with product, finance, data, and business stakeholders to translate real-world business problems into scalable AI systems that deliver measurable value.
Job Description
- Design and develop algorithms for generative models using deep learning techniques
- Design and build LLM-powered applications for internal and/or customer-facing use cases
- Develop and productionize RAG pipelines using enterprise data sources, vector databases, and retrieval systems
- Build and optimize AI agents / agentic workflows for task automation, reasoning, and orchestration
- Integrate model providers such as OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, and open-source models where appropriate
- Create robust evaluation frameworks for response quality, factuality, latency, safety, and reliability
- Implement prompt engineering, structured outputs, tool calling, and model optimization strategies
- Deploy scalable AI services to cloud environments using modern software engineering and MLOps practices
- Build monitoring, observability, and feedback loops for model and application performance in production
- Establish and maintain guardrails, responsible AI practices, and security controls for enterprise AI systems
- Collaborate with product managers, designers, and business stakeholders to identify high-impact AI opportunities
- Mentor other engineers and contribute to architecture, technical direction, and engineering best practices
Qualifications
- Bachelor’s degree in Computer Science, Engineering, Machine Learning, or a related field
- 5+ years of software engineering, machine/deep learning engineering, or applied AI experience
- 2+ years of hands-on experience building and deploying Generative AI / LLM-based systems in production
- Strong programming skills in Python and experience with backend/API development
- Experience with LLM application development, including prompt engineering, RAG, tool use, and structured output design
- Experience in optimizing RAG pipelines using both structured and unstructured data
- Experience with orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or equivalent
- Experience in generative AI techniques such as GANs, and VAEs
- Hands-on experience with vector databases / retrieval systems such as Pinecone, Weaviate, Chroma, FAISS, Elasticsearch, or Azure AI Search
- Experience with cloud platforms such as AWS, GCP, or Azure
- Experience with Docker, Kubernetes, CI/CD, and production deployment practices
- Strong understanding of software architecture, scalability, reliability, and distributed systems
- Experience building evaluation, testing, and monitoring for AI systems
- Strong communication skills and ability to work closely with technical and non-technical stakeholder
Preferred Qualifications
- Experience fine-tuning or adapting open-source LLMs
- Advanced knowledge of natural language processing for text generation tasks
- Experience with PyTorch, TensorFlow, JAX, or related ML frameworks
- Experience with MLOps tools such as MLflow, SageMaker, Vertex AI, Azure ML, Kubeflow, or similar
- Experience building multi-agent systems or advanced orchestration workflows
- Experience with AI safety, guardrails, red-teaming, privacy, and governance
- Familiarity with search, ranking, recommendation, conversational AI, or enterprise knowledge systems
- Experience in customer-facing or enterprise SaaS products
- Experience in semiconductor/manufacturing, retail and e-commerce sectors
All your information will be kept confidential according to EEO guidelines.
Similar Jobs
Automotive • eCommerce • Manufacturing
Lead design, development, and production deployment of generative AI solutions (LLM apps, RAG, agents). Build production RAG pipelines, integrate model providers, implement evaluation and monitoring, establish guardrails, and collaborate with stakeholders while mentoring engineers and guiding architecture and best practices.
Top Skills:
AnthropicAWSAws BedrockAzureAzure Ai SearchAzure MlAzure OpenaiChromaCi/CdDockerElasticsearchFaissGansGCPJaxKubeflowKubernetesLangchainLlamaindexMlflowOpenaiPineconePythonPyTorchSagemakerSemantic KernelTensorFlowVaesVertex AiWeaviate
Insurance • Software
The Senior Software Engineer will design and implement Generative AI solutions, collaborate with teams, enhance AI applications, and mentor others in best practices.
Top Skills:
Ai Observability ToolsAi Orchestration FrameworksAngularAWSAzureDb2GCPIbmJavaJavaScriptLangchainPostgresPythonReactSQL ServerVue
Fintech • Financial Services
Lead design, development, testing, debugging, and documentation of large-scale software solutions. Drive complex, companywide engineering initiatives, define standards and best practices, mentor junior engineers, collaborate with senior technical experts, and resolve enterprise-level technical challenges. Support CI/CD, performance tuning, security testing, and Agile delivery.
Top Skills:
AgileAnthillAPIsAppdynamicsBlazemeterCalypsoCi/CdDb2 LuwJasmineJavaJenkinsJIRAJmeterJunitKarmaLinuxMavenMongoDBMs SqlOraclePenetration TestingRestful Web ServicesSASSeleniumSoap Web ServicesSplunkSpringSpring BatchSpring BootSQLStatic Code AnalysisSvnTeradataUiUnixUrbancode Deploy
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center


