Logo-of-Cartesia-hiring-for-jobs-in-US-on-GrabJobs

Evaluations Operations Analyst (Contract)

salary Salary :

$25 - 35 hourly

icon building Company : Cartesia
icon briefcase Job Type : Full Time
icon remote-alt Remote / Work from Home

Number of Applicants

 : 

000+

Click to reveal the number of candidates who applied for this job.
icon loader
Apply Now
icon loader Apply Now

Let AI Supercharge Your Job Hunt!

JobCopilot scans 500,000+ company career sites daily to find jobs for you

Never miss an opportunity Save hours by auto-filling applications forms Land more interviews with tailored applications
happy man
thunder iconActivate JobCopilot

Job Description - Evaluations Operations Analyst (Contract)

About Cartesia

Our mission is to architect AI that learns from and interacts with the world like humans do.

We're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models. Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship cutting edge models and experiences.

We're funded by leading investors at Index Ventures and Lightspeed Venture Partners, along with Factory, Conviction, A Star, General Catalyst, SV Angel, Databricks and others. We're fortunate to have the support of many amazing advisors, and 90+ angels across many industries, including the world's foremost experts in AI.

About the Role

We are a research lab looking for an Evaluations Operations Analyst to support our evaluation operations as we scale our audio model development. You will work alongside our Evaluations Manager within the Product and Research Operations team, helping run the day-to-day operations for our globally distributed workforce.

Your Impact

  • Serve evaluation tasks to our annotator workforce and manage assignment distribution across projects and locales.

  • Track and verify completion of assignments, flagging delays or issues before they become blockers.

  • Act as a first line of support for evaluators, fielding operational questions about project setup, platform access, and task instructions.

  • Help maintain project trackers, assignment records, and operational documentation.

  • Support calibration workflows as needed to ensure evaluation data meets our quality bar.

What You Bring

  • Experience managing or coordinating annotator workforces, including task assignment, scheduling, and follow-up.

  • Hands-on experience with data annotation platforms.

  • Strong written communication skills, particularly in coordinating with globally distributed contractor workforces in different time zones and language groups.

  • Ability to work independently and manage your own time effectively to meet tight project deadlines.

  • Comfort working in spreadsheets, task management tools (e.g., Asana), and messaging platforms (e.g., Slack).

Nice to Have

  • Experience with linguistics or in language-related fields.

  • Proficiency in languages beyond English to assist with multilingual evaluation workflows.

  • Familiarity with human evaluation methodologies (e.g., scale-based ratings).

  • Proficiency in using LLM assistants to move quickly without sacrificing quality.

Details

  • Rate: $25-35/hr

  • Hours: 20-40 hrs a week

  • Location: US-based (remote)

  • Duration: Initial 3 months (with potential for extension)

Please Note: This position is a contractor role and is not eligible for the full-time employee (FTE) benefits listed below. Contractors are engaged on an independent basis and do not receive company-sponsored health insurance, retirement plans, paid time off, or some of the other benefits outlined in this posting, which apply exclusively to permanent FTE positions

More Details

In-office policy: We’re an in-person team based out of offices in San Francisco, London and Bangalore. We love being in the office, hanging out together, and learning from each other every day.

Visa sponsorship: We provide visa sponsorship support and assess each circumstance on a case-by-case basis. However, visa sponsorship is dependent on many factors, including the role you are applying for, and the location you are going to be based, and so we can't always guarantee success. Your Recruiter will work with you to understand your visa sponsorship needs from the first call.

We ship fast. All of our work is novel and cutting edge, and execution speed is paramount. We have a high bar, and we don’t sacrifice quality or design along the way.

We support each other. We have an open & inclusive culture that’s focused on giving everyone the resources they need to succeed.

Our Benefits (US Employees Only)

Compensation Competitive base salary alongside attractive equity package.

Health Insurance Fully covered medical insurance along with dental and vision for you and your family.

‍‍‍ Parental Leave 9 weeks paternity & 12 weeks maternity leave

401(k)

Commuter Allowance A monthly stipend to help you get to and from the office.

Flexible PTO Take as much time as you need to recharge your batteries.

Meals & Snacks Lunch, dinner and plenty of snacks, provided daily.

Your own personal Yoshi

Original job Evaluations Operations Analyst (Contract) posted on GrabJobs ©. To flag any issues with this job please use the Report Job button on GrabJobs.
Apply Now
Share Job
Share Job

Auto-Apply to Evaluations Operations Analyst Jobs with your AI JobCopilot

thunder icon Auto-Apply with AI

Similar Evaluations Operations Analyst Jobs in the US

GrabJobs is the no1 job portal in the US, connecting you to thousands of jobs fast! Find the best jobs in the US, apply in 1 click and get a job today!

Mobile Apps

Copyright © 2026 Grabjobs Pte.Ltd. All Rights Reserved.