About the Role
Welo Data is seeking experienced linguists to support a synthetic data generation program for a leading technology client. In this role, you will perform A/B preference testing of machine-generated translations from English into Indic languages, helping to evaluate and improve the quality of AI-generated content.
As a Generative AI Analyst, you will independently review an English source document alongside two machine-generated translations (Variant A and Variant B), select the preferred translation, and provide a written justification for your choice. Each sample is reviewed by three independent validators working in a blind process.
Project Details
- Job Title: Generative AI Analyst - German
- Location: Remote, Germany
- Commitment: 4 weeks
- Employment Type: Freelance Contract
- Pay Rate: $20/hour
What You’ll Do
- Review English source documents alongside two machine-generated German translations.
- Evaluate both variants based on accuracy, fluency, and overall translation quality.
- Select the preferred translation and provide a clear written justification for your assessment.
- Complete assigned samples independently and within established timelines.
- Adhere strictly to project and client guidelines
Requirements:
- Experience in video annotation, multimedia annotation, content quality review, data labeling, computer vision labeling, Generative AI evaluation, or a closely related field.
- Strong attention to detail and ability to identify subtle errors, mismatches, and inconsistencies between prompts and videos.
- Good reading comprehension and ability to accurately compare written prompts against visual outputs.
- Strong written communication skills in English and German (Germany), with the ability to describe errors clearly and concisely.
- Ability to follow detailed guidelines consistently and maintain high accuracy across repetitive tasks.
- Critical thinking and sound judgment when reviewing ambiguous or complex scenarios.
- Basic understanding of robotics behavior in real-world environments.
- Comfortable working in structured annotation platforms or similar tools.
- Ability to maintain focus and quality while reviewing multimedia content for extended periods.