Salary :
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Generative Audio Evaluation Specialist based in Brazil.
Join a specialized AI evaluation project focused on testing the quality and performance of generative audio models.
You’ll assess AI-generated audio across short video and text-to-audio tasks, helping identify issues and opportunities for improvement.
Your evaluations will cover speech, music, sound effects, voice quality, synchronization, and compliance with task requirements.
The role combines strong listening skills with careful analysis and consistent application of detailed evaluation guidelines.
You’ll work remotely on a flexible, part-time freelance schedule, making this an accessible opportunity to contribute to the evolution of AI.
Your feedback and scoring will directly support the refinement of advanced generative audio technologies.
This is an excellent entry point for detail-oriented Portuguese speakers interested in AI, language, audio, and emerging technologies.
Accountabilities:
- Evaluate AI-generated audio for short video and text-to-audio tasks according to detailed project guidelines.
- Assess speech, background music, and sound effects for clarity, quality, naturalness, and overall audio performance.
- Evaluate audio-video synchronization, including lip-sync accuracy, timing, and alignment between generated audio and visual content.
- Verify that generated audio accurately follows provided captions, text instructions, and task-specific requirements.
- Assess the naturalness and quality of generated voices and, when applicable, compare them against reference audio.
- Assign accurate scores based on established evaluation criteria and consistently document identified issues.
- Provide detailed and reliable feedback that can help identify model weaknesses and improve generative audio performance.
- Complete required project evaluations and testing within established deadlines.
Requirements:
- Native-level fluency in Portuguese.
- Strong attention to detail and excellent listening skills.
- Good understanding of spoken language, audio quality, context, and natural-sounding speech.
- Ability to follow detailed evaluation guidelines accurately and consistently.
- Strong analytical skills and the ability to identify subtle differences or quality issues in generated audio.
- Reliable equipment, including high-quality headphones suitable for detailed audio evaluation.
- Ability to complete the required evaluation test within 48 hours of receiving the assignment.
- Availability to work at least 10 hours per week on a flexible schedule.
- Comfortable working independently in a remote freelance environment.
- Successful completion of the required qualification process, including language assessments, onboarding, and project-specific testing such as TTS evaluation, audio evaluation, or transcription testing.
- Applicants should select the vendor status that accurately reflects whether they operate as a freelancer/business or as a private individual.
Benefits:
- Fully remote position within Brazil.
- Freelance work arrangement.
- Part-time commitment of 10+ hours per week.
- Flexible schedule — work whenever you want within the project requirements.
- Compensation of US$6 per hour.
- Opportunity to contribute to the development and improvement of generative AI technology.
- Specialized experience in AI evaluation, audio quality assessment, and emerging generative technologies.
- Equal-opportunity environment committed to diversity, equity, and inclusion.
Your email job alert is now active!
