AI Quality Analyst (Healthcare)

We're looking for an AI Quality Analyst to support live deployments of AI systems for an early-stage AI company building coordination tools for home care agencies. This is not a passive monitoring role. You will play a critical part in ensuring AI agents perform reliably in real-world environments, stepping in when needed, exercising sound judgment, and helping the team continuously improve system performance.

You will be reviewing call transcripts and text messages generated by AI agents, escalating issues to customers and internal counterparts, and flagging edge cases that the system cannot handle on its own. The volume is high, the timelines are tight, and the work requires someone who stays sharp under pressure and communicates clearly without needing to be told what to do next.

Why You'll Want to Join

• You will be paid in USD (bi-monthly: every 15th and 30th)
• Paid Time Off in accordance with company policy
• Observance of Holidays per company guidelines
• 100% remote setup so you can work wherever you're most productive
• Work directly inside an early-stage AI company building meaningful infrastructure for the home care industry
• Be part of a team that moves fast and values your judgment

What You'll Work On

Real-Time Monitoring and QA

• Review live AI-driven interactions including call transcripts and text messages to ensure accuracy and quality of outcomes
• Identify inconsistencies, edge cases, and failure patterns in system behavior
• Flag issues proactively, including when expected system outputs are missing or delayed

Human-in-the-Loop Intervention

• Step in when the AI encounters ambiguity, failure cases, or situations requiring human judgment
• Interpret nuanced or incomplete inputs and determine the appropriate next step without waiting for direction
• Recognize when an AI interaction is no longer valid and take ownership of resolving it

Escalation and Communication

• Translate issues into clear, structured, and actionable communication for internal teams and customers
• Communicate through Slack, Teams, and other platforms as needed
• Maintain a high standard of written and verbal English across all interactions

Operational Support and Continuous Improvement

• Help ensure smooth execution of active pilots and deployments
• Surface recurring patterns and insights to inform product and workflow improvements
• Document edge cases and support the development of processes for handling them in the future

What You Bring

• 2 to 3 years of experience in operations, quality assurance, technical support, or a similar role
• Strong ability to spot inconsistencies, edge cases, and failure patterns under high volume
• Clear and concise communicator in both written and spoken English at a professional level
• Comfortable making decisions in ambiguous, fast-moving environments without constant direction
• Able to navigate multiple communication platforms such as Slack, Teams, and SMS simultaneously
• Highly reliable and responsive with the ability to operate effectively in real-time workflows
• Available to work 9 AM to 5 PM Eastern Time Monday through Friday

Nice to Have

• Familiarity with EMR or EHR systems, training available for the right candidate
• Experience in a healthcare-adjacent or home care environment
• Spanish or Mandarin language proficiency
• Background working at an early-stage startup or in a high-ambiguity environment

How to Apply

Please include:

1. Your updated resume
2. A short Loom video (1 to 2 minutes) introducing yourself, describing a situation where you identified and resolved an ambiguous or unexpected problem independently, and explaining how you communicate issues clearly under time pressure

Only candidates who submit a Loom video will be moved to the next step of the hiring process.

If you stay sharp under pressure, catch things others miss, and take ownership of problems before anyone asks you to, this role puts your judgment at the center of AI systems that support real home care workers every day.

Application Process Overview

Our comprehensive selection process ensures we find the right fit for both you and our clients:

1. Initial Application - Submit your application and complete our prequalifying questions
2. Video Introduction - Record an video introduction to showcase your communication skills and work experience
3. Role-Specific Assessment - Complete a homework assignment tailored to the position (if applicable)
4. Recruitment Interview - Initial screening with our talent team
5. Executive Interview - Meet with senior leadership to discuss role alignment
6. Client Interview - Final interview with the client team you'd be supporting
7. Background & Reference Check - Professional reference verification
8. Job Offer - Successful candidates receive a formal offer to join the team

Each stage is designed to evaluate your fit for the role while giving you insights into our company culture and expectations. We'll keep you informed throughout the process and provide feedback at each step.