Medical Expert (AI Clinical Evaluation)

About Us

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for medical students, residents, physicians, and professionals with equivalent biomedical expertise to create and evaluate challenging medical questions designed to test advanced AI systems. The work focuses on diagnosis, disease mechanisms, pharmacology, clinical guidelines, and medical reasoning, with a strong emphasis on evidence-based research and clinically defensible answers.

CONTRACT: Contractor assignment

COMMITMENT: Subject to minimum weekly task submissions

LOCATIONS: Remote, GLOBAL

HOURLY RATE: $40-$90/h

Responsibilities

• Create high-difficulty medical questions and answers across clinical and biomedical topics.
• Develop questions that require synthesis and clinical reasoning rather than simple factual recall.
• Research and verify answers using primary literature, clinical guidelines, and authoritative medical sources.
• Document supporting rationale and references clearly.
• Evaluate AI-generated responses for clinical accuracy, reasoning quality, and completeness.
• Identify questions that are too straightforward and refine them to increase appropriate difficulty.
• Ensure questions and answers are precise, unambiguous, and medically defensible.
• Review content involving diagnosis, mechanisms, pharmacology, guidelines, and clinical decision-making.
• Incorporate reviewer feedback and revise submissions according to project standards.

• Current medical student, medical resident, practicing physician, or equivalent biomedical professional.
• Strong ability to research and interpret primary medical literature and clinical guidelines.
• Ability to develop medically accurate questions requiring advanced reasoning and synthesis.
• Strong understanding of clinical medicine, biomedical science, or a relevant medical specialty.
• Ability to verify medical claims using reliable and authoritative sources.
• Strong written English with the ability to communicate medical reasoning clearly.
• Ability to produce detailed, accurate, and well-supported independent work.
• Availability to meet the project's minimum weekly task requirements.