Bilingual Evaluator - Internet Culture Expert

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Internet-Native Bilingual Evaluator Expert (Spanish – Latin America)
Type: Contract
Compensation: $25/hour
Location: Remote
Commitment: 10–20 hours/week

Role Responsibilities

• Evaluate AI model outputs across English and Spanish to ensure accuracy in modern online communication, cultural references, and multilingual interactions.
• Analyse content from social media, forums, and online communities for naturalness, fluency, and cultural appropriateness.
• Identify issues with slang, memes, abbreviations, and evolving online language specific to Latin American internet culture.
• Develop detailed rubrics and guidelines for evaluating bilingual and internet-native communication.
• Test language models using real-world multilingual prompts and provide structured feedback to improve model performance.
• Collaborate with project leads to maintain consistency across datasets and improve evaluation frameworks.

Qualifications

Must-Have

• Native or near-native fluency in Latin American Spanish and professional fluency in English.
• Deep familiarity with internet culture and online communities in Spanish-speaking countries in Latin America.
• Active engagement with platforms like YouTube, TikTok, Reddit, Discord, Instagram, Twitch, Facebook, and WhatsApp.
• Strong understanding of Latin American Spanish slang, memes, and digital culture.
• Strong writing, analytical, and critical thinking skills.

Preferred

• Experience in content moderation, localisation, translation, linguistics, social media, journalism, or AI evaluation.
• Familiarity with regional linguistic differences across Mexico, Argentina, Colombia, Chile, Peru, and other Spanish-speaking countries.
• Experience evaluating user-generated content or digital communications.
• Interest in AI, language models, and internet culture research.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.