Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handles inbound calls and warm leads, consults customers on insurance needs, recommends appropriate Property and Casualty coverages, and converts prospects into policyholders. The role includes paid training and licensing support, customer-focused sales, lead conversion, schedule flexibility, and remote work. Representatives must meet state licensing requirements, maintain a professional home workspace, and work four weekdays plus one weekend day.
Top Skills:
PcWired High-Speed Internet
Cloud • Software
Lead the architecture, operation, and reliability of Cisco ThousandEyes’ FedRAMP-compliant AWS GovCloud platform. Build resilient cloud-native services using infrastructure as code, maintain high availability and security for high-volume data streams, automate compliance controls and auditing, and optimize multi-region infrastructure. Collaborate with engineering and security teams, lead technical initiatives, address operational risks, and establish engineering standards for regulated environments.
Top Skills:
AWSKubernetesPythonTerraform
.png)
Artificial Intelligence • Big Data • Software • Analytics • Business Intelligence • Big Data Analytics
The Director of Revenue Operations will build and lead Hex’s RevOps center of excellence, owning compensation, territory design, capacity planning, quota setting, pipeline modeling, forecasting, and recurring operational programs. The role partners with Sales, Finance, Recruiting, Legal, Systems, and executive leadership to automate processes, improve forecast accuracy, support hiring plans, and report on go-to-market performance.
Top Skills:
AIAnaplanCaptivateiqCompensation ToolsCRMData ModelsFullcastPlanning ToolsSalesforceSpiff
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
