The ML/LLM Engineer will optimize pipelines for ML and LLM systems, fine-tune models, collaborate on healthcare applications, and enhance model quality and safety.
About Our Client
Our client is revolutionizing healthcare by streamlining knowledge workflows with AI. They reduce administrative burdens and elevate outcomes, empowering professionals to focus on what truly matters — improving lives. They’re growing fast and looking for bold, driven teammates to join them.
The Opportunity
Our client is seeking a hands-on ML/LLM Engineer who’s excited to ship real-world applications — not just benchmarks. You’ll help build and optimize AI-native systems that blend structured and unstructured data to power decisions in high-stakes domains. This is a mid to senior-level role for someone ready to go deep on applied ML problems — from retrieval to routing to generation — and ship solutions that deliver measurable impact.
What You’ll Do
- Own and optimize pipelines that combine classical ML and LLM-based systems (RAG, scoring, summarization, etc.)
- Fine-tune and evaluate LLMs using both open-source and proprietary data
- Collaborate with product and engineering teams to build real-world applications in healthcare and biopharma
- Implement retrieval strategies, prompt chaining, and inference orchestration for production use cases
- Monitor and improve model quality, latency, explainability, and safety
- Stay ahead of the curve in LLM evaluation, tuning, and agent-based architectures
Qualifications
- 5+ years of experience in applied ML, with at least 1–2 years working with LLMs
- Strong Python skills and familiarity with ML/LLM frameworks (PyTorch, Transformers, LangChain, LlamaIndex, etc.)
- Comfort with embeddings, vector search, retrieval pipelines, and prompt tuning
- Bias for experimentation, clarity, and pushing solutions into production quickly
- Understanding of responsible AI practices, model evaluation, and observability
- Experience in healthcare, compliance-sensitive data, or regulated environments
What Our Client Offers
- Opportunity to make a real impact on the future of healthcare
- Autonomy, ownership, and growth potential
- 100% employer-paid health, vision, and dental insurance
- Retirement plans (401k), disability insurance, and employee assistance programs
Work Authorization:
This position is open only to individuals who are legally authorized to work in the United States on a permanent basis. At this time, the company is unable to sponsor or take over sponsorship of employment visas (including H-1B, OPT, CPT, or other non-immigrant statuses).
Candidates must be U.S. citizens or lawful permanent residents (Green Card holders) to be eligible for this role.
The base pay range for this role is $140,000 – $160,000 per year.
Similar Jobs
Artificial Intelligence • Big Data • Computer Vision • Information Technology • Machine Learning • Analytics • Defense
Develop and deploy reliable machine learning, LLM-powered agent, and agentic workflow systems for government and enterprise customers. Integrate models with tools, APIs, MCP servers, and data sources; build evaluation frameworks for performance, reliability, and safety; improve Chariot, the company’s AI operations platform; and support mission-critical deployments. Collaborate with data scientists, software engineers, DevOps teams, and customers in secure government environments.
Top Skills:
AngularC++Ci/CdDockerGoGraphQLInfrastructure As CodeJavaKubernetesMcp ServersPythonPyTorchReactRestRetrieval-Augmented Generation (Rag)RustScalaScikit-LearnTensorFlowVersion ControlVue
Artificial Intelligence • Big Data • Computer Vision • Information Technology • Machine Learning • Analytics • Defense
Develop and deploy reliable machine learning, LLM, agentic, and data-centric systems for government and enterprise customers. Build and evaluate AI agents, workflows, tool integrations, and retrieval-augmented systems; measure performance, reliability, and safety; and improve the Chariot AI operations platform. Collaborate with customers, data scientists, software engineers, and DevOps teams on mission-critical deployments. The role is fully remote or hybrid in Austin, with travel up to 20%.
Top Skills:
AngularC++Ci/CdDockerGoGraphQLInfrastructure As CodeJavaKubernetesMcpPythonPyTorchRagReactRestRustScalaScikit-LearnTensorFlowVue
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Design and build large-scale mapping algorithms and geospatial data systems for automated map reconstruction and maintenance. Develop lane, road-network, geometry, topology, and map-conflation systems; process sensor and third-party data through distributed pipelines; apply machine learning and computer vision for feature extraction and change detection; and create automated validation and quality systems. Partner with perception, localization, simulation, and platform teams while mentoring engineers and driving technical problems into production.
Top Skills:
C++Computer VisionDistributed Data PipelinesGdal/OgrGeojsonGeopandasH3Machine LearningOsmPostgisPythonS2Slam
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center


