Overview:
We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.
Project Details:
Start Date: ASAP
Duration: 10 hours/week
Job Type: Freelance
Location: Remote (United States)
Language: English
Pay Rate: $26.33/hour
Responsibilities
- Listen carefully to recorded conversations between a person and an AI voice agent
- Rate each of the agent's turns on two independent 1–5 scales:
- Content – Was the response helpful, relevant, and appropriate?
- Prosody – Did the voice sound natural, well-paced, and expressive?
- Write a short, specific, and clear justification for each score given
What We're Looking For:
- Strong listening and attention-to-detail skills
- Ability to give consistent, well-reasoned ratings
- Clear, concise written communication
- Reliable availability for ~10 hours/week
Thank you for your interest in joining Welo Data’s community and contributing to this exciting project. We look forward to collaborating with you!
$26.33 - $26.33 an hour
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Your email job alert is now active!
