We are seeking PhD-level Chemistry experts to support a high-impact project focused on improving the quality, reliability, and usefulness of advanced conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real-world questions.
In chemistry-related contexts, AI systems must demonstrate accurate mechanistic reasoning, quantitative precision, and a strong understanding of chemical principles across both theoretical and applied domains. This role focuses on evaluating and enhancing how AI models reason about, explain, and communicate chemistry concepts across foundational and advanced topics.
What You’ll Do
Write and refine prompts to guide AI model behavior in chemistry-related contexts
Evaluate AI-generated responses to chemistry questions for scientific accuracy, mechanistic correctness, and quantitative reasoning
Conduct fact-checking using authoritative public sources and domain knowledge
Annotate model responses by identifying strengths, weaknesses, and factual or conceptual inaccuracies
Assess the clarity, structure, and appropriateness of explanations for different audiences
Ensure responses align with expected conversational behavior and established system guidelines
Apply consistent evaluation standards using structured taxonomies, benchmarks, and detailed review guidelines
Who You Are
You hold a PhD in Chemistry or a closely related discipline
You have deep expertise in one or more of the following areas:
Organic & Biological Chemistry
Inorganic & Materials Chemistry
Physical & Theoretical Chemistry
Analytical & Instrumental Chemistry
You have experience using large language models (LLMs) and understand how people interact with them
You possess excellent writing and communication skills, with the ability to clearly explain complex chemistry concepts
You have strong attention to detail and can identify subtle issues in technical explanations
You have experience reviewing or editing technical or academic content
Nice-to-Have Experience
Prior work involving RLHF, model evaluation, or data annotation
Experience teaching, mentoring, or explaining chemistry concepts to non-expert audiences
Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
What Success Looks Like
You consistently identify inaccuracies or weak reasoning in chemistry-related AI outputs
Your feedback improves the rigor, clarity, and scientific correctness of AI-generated explanations
You deliver consistent and reproducible evaluation artifacts that strengthen overall model performance
AI systems become more reliable in chemistry-related contexts due to your rigorous evaluations
Why This Role
This role offers PhD-level chemists the opportunity to apply their expertise beyond traditional academic or industry settings, contributing directly to the development of advanced AI systems that reason about and explain chemical concepts. It allows you to work on high-impact AI development projects while maintaining flexibility and autonomy in your schedule.
Contract and Payment Terms
Engagement will be as an independent contractor
This is a fully remote role that can be completed on your own schedule
Projects may be extended, shortened, or concluded early depending on project needs and performance
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Payments are issued weekly via Stripe or Wise based on services rendered
Please note: Candidates requiring H1-B or STEM OPT sponsorship cannot be supported for this role at this time.
All Job Ads are subject to GrabJobs’s Terms of Service. We allow users to flag postings that may be in violation of those terms. Job Ads may also be flagged by GrabJobs moderation team. However, no moderation system is perfect, and flagging a posting does not ensure that it will be removed.
Be the first to receive the latest Others Full-Time Jobs in the US.
Setup your job alert:
By activating job alerts, I agree to GrabJobs Terms & Privacy Policy. I can unsubscribe to job alerts anytime.
Skip
GrabJobs is the no1 job portal in the US, connecting you to thousands of jobs fast!
Find the best jobs in the US, apply in 1 click and get a job today!