Weekday, Inc. Logo

Weekday, Inc.

Data Science Expert

Reposted 18 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
120-170 Hourly
Senior level
Remote
Hiring Remotely in United States
120-170 Hourly
Senior level
Design task-specific, objective evaluation frameworks for data science deliverables. Assess AI- and human-generated analyses, models, dashboards, experiments, and recommendations using reproducible scoring. Produce detailed written justifications, refine methodologies with reviewer feedback, and collaborate with cross-functional teams to improve AI training and evaluation standards.
The summary above was generated by AI

This role is for one of our clients

Compensation: $120-$170 per hour

Join a leading AI research organization working on the next generation of intelligent systems. We are seeking experienced Data Science Experts to help evaluate how effectively AI performs real-world data science tasks. Rather than building models or delivering business analyses yourself, you will define what high-quality work looks like by creating robust evaluation frameworks and assessing AI-generated outputs with structured, evidence-based feedback.

This is an excellent opportunity to apply your industry expertise to improve advanced AI systems while influencing how they reason through complex analytical problems.


RequirementsKey Responsibilities
  • Design detailed, task-specific evaluation criteria for real-world data science deliverables, including:
    • Data analyses
    • Predictive and statistical models
    • Dashboards and visualizations
    • Experiment results
    • Executive recommendations and business insights
  • Evaluate AI-generated and human-produced work using objective scoring frameworks.
  • Provide detailed written justifications for each evaluation, ensuring consistency and technical accuracy.
  • Apply sound analytical judgment to produce reproducible and defensible assessments.
  • Incorporate structured reviewer feedback and continuously refine evaluation methodologies.
  • Collaborate with cross-functional teams to improve AI training quality and evaluation standards.
Required Qualifications
  • 5+ years of professional experience in Data Science within an industry environment.
  • Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
  • Deep expertise in:
    • Experimental design and A/B testing
    • Statistical analysis
    • SQL and Python
    • Metric development and performance measurement
    • Translating analytical findings into business recommendations
  • Excellent written communication skills with the ability to clearly explain technical reasoning.
  • Exceptional attention to detail and the ability to evaluate work consistently against structured rubrics.
  • Comfortable receiving feedback and calibrating evaluation standards with peer reviewers.
Preferred Qualifications
  • Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives.
  • Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows.
  • Experience reviewing technical work or mentoring analytical teams is a plus.
Application Process
  • Submit your resume or relevant technical background to begin the application process.
  • Qualified candidates may be invited to complete a short technical assessment or provide additional information relevant to their expertise.
Why Join?
  • Contribute to the development of next-generation AI systems used for real-world analytical reasoning.
  • Apply your professional data science expertise to high-impact AI evaluation projects.
  • Work remotely with flexible scheduling.
  • Collaborate with a network of experienced technical professionals helping define the future of AI quality and reasoning.

We welcome applicants from all backgrounds and are committed to providing equal opportunities and reasonable accommodations throughout the recruitment process.

Contract Details
  • Independent contractor engagement.
  • Fully remote with flexible working hours.
  • Project duration may be extended or concluded based on project requirements and performance.
  • Weekly payments based on approved work completed.
  • Please note that H1-B and STEM OPT sponsorship is not available for this engagement.

Similar Jobs

Mid level
HR Tech • Information Technology • Professional Services • Consulting
Reviews and refines AI-generated content and data outputs, develops prompts, evaluates model performance using rubrics, conducts independent research and fact-checking, annotates data, and summarizes complex findings in technical reports. Works asynchronously with project leads and domain experts to improve AI output quality and analytical standards.
Top Skills: AIData AnnotationData ScienceMachine LearningPrompt EngineeringRlhfTechnical Documentation
17 Days Ago
Remote
United States
60-90 Hourly
Junior
60-90 Hourly
Junior
Artificial Intelligence • HR Tech • Professional Services • Software
Design realistic, multi-step data analysis benchmark tasks and create reproducible reference analyses. Evaluate AI-generated analyses for correctness, statistical validity, and interpretation. Collaborate with researchers to improve benchmark quality and document methodologies in Jupyter/Colab notebooks.
Top Skills: GitGoogle ColabJupyter NotebooksNumpyPandasPythonScikit-LearnScipy
19 Minutes Ago
Remote or Hybrid
264K-500K Annually
Senior level
264K-500K Annually
Senior level
Cloud • Software
Own strategic enterprise accounts across New England for ThousandEyes, driving new-logo acquisition and customer expansion. Build executive relationships, independently generate pipeline, leverage Cisco’s sales ecosystem, and lead complex enterprise sales cycles through technical evaluation, negotiation, and close. Manage six- and seven-figure transactions, develop strategic account plans, expand customers into $1M+ ARR relationships, and maintain quota attainment, pipeline coverage, and forecast accuracy.
Top Skills: Cisco ThousandeyesCloud NetworkingCybersecurityEnterprise Technology SolutionsObservabilitySaaS

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account