Assess machine-transliterated song lyrics for quality and accuracy, providing feedback to improve systems and maintaining clear judgment in reviews.
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
ROLE OVERVIEW
We are looking for a Korean Speaker to evaluate machine-transliterated song lyrics. Your focus will be on assessing the quality and accuracy of the transliteration from Korean into other languages and you feedback will directly contribute to improving automated transliterated systems.
No prior experience is required to perform this role, just a good command of Korean speaking level (native-level or near-native). Full training will be provided.
MAIN RESPONSIBILITIES
- Review and assess machine-transliterated lyrics for meaning, fluency, and naturalness.
- Provide quality ratings based on predefined evaluation criteria.
- Identify and correct issues such as inaccurate transliterations and mistranslated words.
- Maintain consistent and objective judgment throughout the review process.
JOB REQUIREMENTS
- Native-level or near-native proficiency of Korean into other languages. Please see the list of languages when you apply.
- Great Korean linguistics skills, including expressions and cultural context.
- Excellent attention to detail.
- Be able to maintain concentration working on a large volume of content.
- While no previous experience is needed, experience in localization or linguistic evaluation will be a plus.
- Having a music interest will be very beneficial if you can differentiate genres and lyrical styles, but not mandatory.
- Experience using online evaluation tools or platforms will be an advantage.
PROJECT DETAILS
START DATE: ASAP
LOCATION: Remote
WORKING HOURS: Flexible (average of 4 hours per day)
EMPLOYMENT TYPE: Freelance
DURATION: Indefinitely
PAY RATE: $13 per hour
READY TO JOIN US?
This is a great opportunity to contribute to the evolution of AI and language technology, especially in the music space, while working flexibly remotely. You will gain experience in the growing field of linguistic evaluation and have the chance to work on a very exciting project that blends language, culture, and technology.
Job Reference: #LI-JC1
Top Skills
Online Evaluation Tools
Similar Jobs
Enterprise Web • Hardware • Internet of Things • Software
As a Forward Deployed Engineer, you will design, build, and implement solutions for manufacturers, leveraging Tulip's Frontline Operations Platform, while collaborating closely with plant-level stakeholders to enhance operational efficiency and quality.
Top Skills:
AICloud-NativeErpMesNo-Code PlatformPlcs
Enterprise Web • Hardware • Internet of Things • Software
The Product Support Engineer serves as the primary contact for customers, diagnosing and resolving technical issues, educating customers on the product, and collaborating with various teams to improve support processes and tools.
Top Skills:
APIsAtlassianAWSAzureConfluenceHTTPJIRAMongodbPostgresShell ScriptingSQLZendesk
Enterprise Web • Hardware • Internet of Things • Software
This role involves managing the full sales cycle for SaaS solutions within the manufacturing sector, exceeding quotas, and building relationships with key stakeholders.
Top Skills:
Linkedin Sales NavigatorOutreachSalesforceZoominfo
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

