The ML/LLM Engineer will optimize pipelines for ML and LLM systems, fine-tune models, collaborate on healthcare applications, and enhance model quality and safety.
About Our Client
Our client is revolutionizing healthcare by streamlining knowledge workflows with AI. They reduce administrative burdens and elevate outcomes, empowering professionals to focus on what truly matters — improving lives. They’re growing fast and looking for bold, driven teammates to join them.
The Opportunity
Our client is seeking a hands-on ML/LLM Engineer who’s excited to ship real-world applications — not just benchmarks. You’ll help build and optimize AI-native systems that blend structured and unstructured data to power decisions in high-stakes domains. This is a mid to senior-level role for someone ready to go deep on applied ML problems — from retrieval to routing to generation — and ship solutions that deliver measurable impact.
What You’ll Do
- Own and optimize pipelines that combine classical ML and LLM-based systems (RAG, scoring, summarization, etc.)
- Fine-tune and evaluate LLMs using both open-source and proprietary data
- Collaborate with product and engineering teams to build real-world applications in healthcare and biopharma
- Implement retrieval strategies, prompt chaining, and inference orchestration for production use cases
- Monitor and improve model quality, latency, explainability, and safety
- Stay ahead of the curve in LLM evaluation, tuning, and agent-based architectures
Qualifications
- 5+ years of experience in applied ML, with at least 1–2 years working with LLMs
- Strong Python skills and familiarity with ML/LLM frameworks (PyTorch, Transformers, LangChain, LlamaIndex, etc.)
- Comfort with embeddings, vector search, retrieval pipelines, and prompt tuning
- Bias for experimentation, clarity, and pushing solutions into production quickly
- Understanding of responsible AI practices, model evaluation, and observability
- Experience in healthcare, compliance-sensitive data, or regulated environments
What Our Client Offers
- Opportunity to make a real impact on the future of healthcare
- Autonomy, ownership, and growth potential
- 100% employer-paid health, vision, and dental insurance
- Retirement plans (401k), disability insurance, and employee assistance programs
Work Authorization:
This position is open only to individuals who are legally authorized to work in the United States on a permanent basis. At this time, the company is unable to sponsor or take over sponsorship of employment visas (including H-1B, OPT, CPT, or other non-immigrant statuses).
Candidates must be U.S. citizens or lawful permanent residents (Green Card holders) to be eligible for this role.
The base pay range for this role is $140,000 – $160,000 per year.
Similar Jobs
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The role involves designing, building, and deploying computer vision models for vehicle damage detection, covering the entire ML lifecycle and collaborating across teams.
Top Skills:
C++Computer VisionMachine LearningMobile DevelopmentNumpyOpencv
News + Entertainment
Design, operate, and scale cloud-native ML infrastructure across GCP and AWS (GPU/TPU), build CI/CD for models, maintain low-latency real-time inference systems, define observability and monitoring for ML models, participate in on-call incident response, and partner with data scientists to improve MLOps and platform usability.
Top Skills:
AerospikeApache AirflowApache FlinkSparkAWSChrononDatadogEksGCPGitlab RunnerGkeGpuGrafanaJavaJenkinsKafkaKubernetesKv StoreMlflowPrometheusPythonRayScalaTerraformTpuVector Database
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
The role involves developing quantization and compression strategies for AV models, conducting numerical sensitivity analyses, and creating automated tooling for low-precision deployments, emphasizing safety and performance.
Top Skills:
AwqGptqModeloptNvidiaOnnxPt2EPyTorchQuipSmoothquantSparsegptTorchao
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
