Welo Global Logo

Welo Global

Red Teaming | Generative AI Analyst - USA (Remote)

Posted 6 Days Ago
Remote
Hiring Remotely in United States
33-33 Hourly
Entry level
Remote
Hiring Remotely in United States
33-33 Hourly
Entry level
Interact with generative AI models to create and evaluate prompts, identify safety failures, document model breakability and failure points, review multimodal content, apply safety taxonomies, perform high-volume annotation sprints, participate in calibration and quality reviews, and flag unclear guidelines or tooling issues.
The summary above was generated by AI
About the Role

We are hiring Red Teaming | Generative AI Analyst to support generative AI safety evaluation. In this role, you will interact with AI models, create and evaluate prompts, and identify where model responses fail against defined safety expectations.

Project Details
  • Job Title: Red Teaming | Generative AI Analyst
  • Location: Remote, USA
  • Hours: 40 hours per week
  • Employment Type: W2 Full-Time Employee
  • Pay Rate: $33.16/hour

What You’ll Do

  • Interact with generative AI models using project-provided guidelines, safety taxonomies, and attack-vector guidance.
  • Create and evaluate prompts designed to test model behavior across safety-related categories.
  • Identify where model responses become unsafe, noncompliant, inconsistent, or otherwise problematic.
  • Document model breakability, effort level, point of failure, and relevant category alignment.
  • Review text, image, audio, video, or other multimodal content as required by the workflow.
  • Apply detailed guidelines consistently across short, high-volume production sprints.
  • Use sound judgment to evaluate ambiguous, edge-case, or policy-sensitive outputs.
  • Conduct self-review to ensure work is accurate, complete, and aligned with project expectations.
  • Flag unclear guidelines, tooling issues, or recurring model behavior patterns.
  • Participate in calibration, feedback, and quality review sessions to improve consistency.
  • Maintain readiness to pivot quickly between different red teaming runs when active work is launched.

Requirements:

  • Native-level or near-native English proficiency with excellent written communication skills.
  • Strong creative writing ability and comfort constructing varied prompts.
  • Work Authorization is required for the role. 
  • Experience with red teaming, safety data annotation, content evaluation, safety review, content moderation, QA, or AI model evaluation preferred.
  • Strong attention to detail and ability to follow complex project guidelines.
  • Ability to think critically and evaluate open-ended model responses.
  • Comfort working with sensitive, adult, NSFW, or policy-relevant content where required.
  • Interest in generative AI, AI safety, large language models, or emerging AI technologies.
  • Ability to work quickly and accurately during short production windows.
  • Bachelor’s degree or equivalent practical experience preferred.

Ways to Stand Out from the Crowd

  • Background in creative writing, English, linguistics, journalism, communications, policy, trust and safety, or content moderation.
  • Experience evaluating generative AI prompts and responses.
  • Familiarity with AI safety, red teaming, jailbreak testing, RLHF, or model evaluation workflows.
  • Experience working with safety taxonomies, policy guidelines, evaluation rubrics, or defect categories.
  • Prior experience reviewing sensitive, adult, NSFW, or policy-relevant content in a professional setting.
  • Experience with multimodal AI workflows involving text, image, audio, or video.
  • QA/testing experience within AI, data operations, content review, or annotation environments.
  • Ability to explain a repeatable approach for staying consistent during high-volume, judgment-based work.

Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
 
To know more details (Click here)
 
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.  In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
 
 
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
 
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.

Similar Jobs

38 Minutes Ago
In-Office or Remote
200K-300K Annually
Expert/Leader
200K-300K Annually
Expert/Leader
Information Technology • Software • Financial Services • Big Data Analytics
Global Quantitative Researchers at Citadel leverage advanced statistical and quantitative techniques to drive investment strategies and optimize portfolios.
Top Skills: C++Python
3 Hours Ago
Remote or Hybrid
Pennsylvania, USA
71K-166K Annually
Junior
71K-166K Annually
Junior
Digital Media • Information Technology • News + Entertainment
Full‑stack .NET developer responsible for writing, maintaining and optimizing code, designing APIs and system architecture, implementing unit/integration tests, supporting deployments, troubleshooting performance issues, and collaborating with QA and stakeholders. May work variable hours including nights/weekends.
Top Skills: AjaxAngularAsp.NetBootstrapperC#Continuous IntegrationCSSEntity FrameworkGitHTMLIisIocJavaJavaScriptJqueryJSONLinqMvc 5Net Core 2.0Net FrameworkOrmSalesforce Experience CloudSap AbapSQL ServerTfsTypescriptVb.NetVisual StudioWeb ApiXML
3 Hours Ago
Remote or Hybrid
Pennsylvania, USA
84K-196K Annually
Senior level
84K-196K Annually
Senior level
Digital Media • Information Technology • News + Entertainment
Design, build, test, and deploy scalable Salesforce solutions across multi-cloud environments using Apex, LWC, Visualforce, declarative tools and integrations (MuleSoft/REST/SOAP). Lead configuration, data modeling, CI/CD, code reviews, troubleshooting, and Agile delivery while mentoring junior engineers and supporting platform governance and long-term architectural alignment.
Top Skills: ApexCi/CdCopadoCSSFlowsGitHTMLJavaScriptLightning App BuilderLightning Web Components (Lwc)Media CloudMulesoftRest ApisSales CloudSalesforce Experience CloudService CloudSoap ApisSOQLSoslVisualforce

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account