Jobs at Careerflow.ai

Evaluate personalized AI responses by designing multi-turn prompts using your own personal context, assessing grounding, integration, and helpfulness, stack-ranking side-by-side model outputs, writing clear rationales, verifying debug info, and maintaining data hygiene. Work full-time as a remote contractor with schedule overlap requirements.

Evaluate personalized AI responses for Gemini by designing multi-turn prompts using personal data, comparing side-by-side responses, assessing grounding, integration, and helpfulness, writing structured rationales, extracting debug info, and maintaining data hygiene.

Remote annotator reviews Japanese text and images, draws bounding boxes, answers structured questions, and writes short summaries per guidelines to train AI systems. On-the-job training provided; assessment required.

Review and annotate Korean text and images (bounding boxes, structured questions, short summaries) following annotation guidelines to train AI systems. Work remote, 30-40 hrs/week for at least 3 months; on-the-job training provided.

Create and edit Spanish linguistic content and annotations, translate/localize English into natural Japanese, perform QA on model outputs for fluency and cultural nuance, annotate Japanese datasets, conduct Spanish linguistic research, and evaluate model behavior to improve Japanese language performance in NLP systems.

Annotate and label audio clips to improve AI models using Label Studio. Follow detailed guidelines and training materials, join training and feedback sessions, meet productivity targets with the Project Manager, and flag unclear samples or guideline issues.

Freelance remote role reviewing images in an online tool to rate technical quality (blur, noise, exposure, compression). Apply guidelines consistently, submit accurate, detail-oriented evaluations, and commit ~20+ hours/week for several weeks.

Create, translate, and localize high-quality Japanese content for LLMs; annotate and QA Japanese datasets; identify linguistic issues, conduct research, and improve NLP model performance.

Produce 1-5 minute walk-and-talk videos showcasing public locations. Speak naturally on camera, record steady footage with clear audio, follow creative guidelines, submit location details, respect privacy and safety, and deliver videos on schedule as a freelance contractor.

Review and annotate Chinese text and images to train AI: draw bounding boxes, answer structured questions, write short summaries, and follow annotation guidelines. Remote, long-term contract (minimum 6 months), 30–40 hours/week, paid hourly with a short language assessment required.

Remote Danish language annotator to review and label text and images, draw bounding boxes, answer structured questions, and write short summaries following annotation guidelines. No prior experience required; on-the-job training provided. 30–40 hours/week, $8/hour, minimum 6-month commitment.

Create high-quality SolidWorks parts across automotive, aerospace, and healthcare domains. Deliver reproducible parametric models, clean feature trees, MBD with full GD&T, 2D drawings, working macros, screen recordings with narration, and structured JSON reasoning logs within a weekend pilot timeframe.

Remote Italian-language annotator to review and label text and image content, draw bounding boxes, answer structured questions, write short summaries, and follow detailed annotation guidelines. Long-term contract with provided training and a short language assessment.

Perform text and image annotation tasks in Turkish: review content, draw bounding boxes, answer structured questions, write short summaries, and follow annotation guidelines to ensure quality. Remote, long-term (minimum 6 months) role with provided training and a short language assessment.

Develop and maintain MCP tools and the MCP Toolbox for Databases; expand test coverage for agentic coding assistants; refactor and maintain test frameworks; convert technical posts into production-ready sample code and documentation; build real-world data applications (QueryData) to support product R&D and collaborate with cross-functional teams to accelerate agentic AI adoption.

Perform text and image annotation in Vietnamese: review content, draw bounding boxes, answer structured questions, write short summaries, and follow annotation guidelines to ensure consistency and quality. Remote, long-term contract with on-the-job training.

Design and build reinforcement-learning training environments and diverse tasks to evaluate and improve LLM agents; iterate rapidly on task designs from customer feedback, deliver high-quality outputs with minimal supervision, and maintain PST overlap for collaboration.

Review and annotate Dutch text and images to train AI systems: draw bounding boxes, answer structured questions, write short summaries, and follow annotation guidelines. Remote long-term contract, training provided; 30–40 hours/week at $5/hour, assessment required.

Create and solve advanced physics problems and develop clear step-by-step solutions and annotations to evaluate LLM reasoning. Build undergraduate-to-PhD benchmarks, collaborate with LLM researchers to improve evaluations, analyze model weaknesses in abstraction and symbolic reasoning, and provide constructive feedback.

Participate in a 60–90 minute scheduled Zoom session to perform scripted, role-based conversational scenarios for AI training. Follow provided prompts and guidelines, maintain natural American English speech patterns, and interact with other participants. Sessions are compensated with a $20 Amazon gift card.