The ML/LLM Engineer will optimize pipelines for ML and LLM systems, fine-tune models, collaborate on healthcare applications, and enhance model quality and safety.
About Our Client
Our client is revolutionizing healthcare by streamlining knowledge workflows with AI. They reduce administrative burdens and elevate outcomes, empowering professionals to focus on what truly matters — improving lives. They’re growing fast and looking for bold, driven teammates to join them.
The Opportunity
Our client is seeking a hands-on ML/LLM Engineer who’s excited to ship real-world applications — not just benchmarks. You’ll help build and optimize AI-native systems that blend structured and unstructured data to power decisions in high-stakes domains. This is a mid to senior-level role for someone ready to go deep on applied ML problems — from retrieval to routing to generation — and ship solutions that deliver measurable impact.
What You’ll Do
- Own and optimize pipelines that combine classical ML and LLM-based systems (RAG, scoring, summarization, etc.)
- Fine-tune and evaluate LLMs using both open-source and proprietary data
- Collaborate with product and engineering teams to build real-world applications in healthcare and biopharma
- Implement retrieval strategies, prompt chaining, and inference orchestration for production use cases
- Monitor and improve model quality, latency, explainability, and safety
- Stay ahead of the curve in LLM evaluation, tuning, and agent-based architectures
Qualifications
- 5+ years of experience in applied ML, with at least 1–2 years working with LLMs
- Strong Python skills and familiarity with ML/LLM frameworks (PyTorch, Transformers, LangChain, LlamaIndex, etc.)
- Comfort with embeddings, vector search, retrieval pipelines, and prompt tuning
- Bias for experimentation, clarity, and pushing solutions into production quickly
- Understanding of responsible AI practices, model evaluation, and observability
- Experience in healthcare, compliance-sensitive data, or regulated environments
What Our Client Offers
- Opportunity to make a real impact on the future of healthcare
- Autonomy, ownership, and growth potential
- 100% employer-paid health, vision, and dental insurance
- Retirement plans (401k), disability insurance, and employee assistance programs
Work Authorization:
This position is open only to individuals who are legally authorized to work in the United States on a permanent basis. At this time, the company is unable to sponsor or take over sponsorship of employment visas (including H-1B, OPT, CPT, or other non-immigrant statuses).
Candidates must be U.S. citizens or lawful permanent residents (Green Card holders) to be eligible for this role.
The base pay range for this role is $140,000 – $160,000 per year.
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build, and support high-throughput, low-latency LLM inference and data pipelines; collaborate with data scientists to post-train and evaluate models; implement scalable, production-ready systems with strong testing, monitoring, and performance focus; mentor engineers and iterate on architecture, reliability, and user-facing AI applications.
Top Skills:
AnsibleAWSCassandraChefDockerElasticsearchGCPGpuGpu-ClustersJvmKafkaKubernetesMaasPythonSparkTerraform
Artificial Intelligence • Big Data • Computer Vision • Information Technology • Machine Learning • Analytics • Defense
Design and deploy production-grade machine learning models and data pipelines across image, video, text, geospatial, time-series, and structured data. Collaborate with customers, data scientists, software and DevOps engineers to define requirements, maintain mission-critical deployments, and contribute to the Chariot AI operations platform.
Top Skills:
PythonPyTorchScikit-LearnTensorFlow
Automotive • Big Data • Insurance • Software • Transportation
Design, develop, and deploy machine learning models and pipelines to optimize operations. Lead full ML project lifecycle, ensure model evaluation/monitoring, collaborate cross-functionally, mentor junior engineers, and drive continuous improvement in ML applications and processes.
Top Skills:
AirflowAws EcrAws S3Aws SagemakerCi/CdDvcNumpyPandasPythonRestful ApisScikit-LearnSQL
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
