Top Tech Jobs & Startup Jobs in Austin, TX

Evaluate AI model outputs, perform audit-style reviews to find patterns and failure modes, apply and refine labeling/evaluation guidelines, document findings, communicate insights to leads and stakeholders, and participate in team calibrations to improve model evaluation and data quality.

Audit and improve data labeling quality in human-in-the-loop ML workflows. Coach and onboard labelers, provide actionable feedback, monitor queues, identify recurring issues, and help refine guidelines and processes.

Evaluate AI outputs and audit model behavior, apply and refine guidelines, identify failure modes and trends, document findings, and collaborate with leads and cross-functional teams to improve evaluation frameworks and data quality.

Evaluate AI model outputs, perform audit-based reviews, apply and refine guidelines, identify performance trends and failure modes, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.

Audit and ensure quality of data labeling outputs, coach and onboard annotators, apply and refine guidelines, monitor workflows and escalate issues, document findings, and support human-in-the-loop AI evaluation processes.

Audit and monitor data labeling outputs, provide actionable feedback, support onboarding and training of annotators, enforce and improve guidelines, escalate workflow issues, and document findings to maintain high-quality human-in-the-loop AI data processes.

Evaluate AI model outputs, perform audit-based reviews, apply and improve guidelines, identify trends and failure modes, document findings, and collaborate with leads and cross-functional teams to refine quality standards.

Audit and ensure quality of data labeling work for ML using human-in-the-loop processes. Provide feedback, train and support annotators, monitor workflows, identify recurring issues, and help improve guidelines and processes.

Evaluate AI outputs, perform audit-based reviews, identify patterns and failure modes, apply and improve annotation/evaluation guidelines, document findings, and communicate insights to cross-functional teams to improve model performance and evaluation frameworks.

Evaluate AI model outputs, perform audit-based reviews to identify patterns and failure modes, apply and refine guidelines, document findings, and collaborate with leads and cross-functional teams to improve model evaluation and data quality.