LLM Training - Physics PhD or PhD candidates

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are seeking Physicists (PhD or Master's Degree) with strong background in upper-undergraduate Physics or beyond to design rigorous Physics problems used to train and evaluate frontier AI models. This role focuses on creating realistic, exam-quality tasks that are solvable by humans yet challenging enough to expose failure modes in advanced language models.

Responsibilities:

• Design and curate upper-undergraduate and graduate-level Physics problems with fully worked, step-by-step solutions.
• Create model-breaking tasks that resemble top university coursework but frequently fail frontier AI models.
• Customize problem sets according to strict client specifications (SI units, LaTeX formatting, explicit constants, closed-form answers).
• Convert multi-part or image-based textbook/exam questions into single, self-contained, text-only problems with one definitive answer.
• Write clear, rigorous solution processes and verify consistency across question, reasoning, final answer, and units.
• Evaluate model outputs, diagnose common failure modes, and iteratively refine problems to ensure difficulty without sacrificing solvability.
• Review and quality-check Physics problems created by others, correcting issues in clarity, correctness, and formatting.
• Collaborate with other trainers, reviewers, and project managers to maintain consistent quality at scale.

Commitments Required: 8 hours per day with an overlap of 4 hours with PST.

Employment type: Contractor assignment (no medical/paid leave)

Duration of contract: 2 months (possible extention)

Location: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico

Selection process: Home Assignment + 15min interview

• Master’s degree or PhD in Physics or a closely related field.
• Strong background in upper-undergraduate Physics or beyond.
• Fluent English, with the ability to write precise and unambiguous scientific text.
• Strong LaTeX proficiency for mathematical derivations and formatting.
• Experience with university teaching, grading, exam design, or research involving analytical problem-solving.
• Excellent attention to detail in units, constants, symbols, and notation.
• Ability to sanity-check and recompute multi-step quantitative solutions.
• Familiarity with modern AI/LLM concepts (e.g., SFT, RLHF, evaluation) and interest in how training data shapes model behavior.
• Physics Domain Expertise:
•  Basic Physics
•  Condensed Matter
•  Quantum
•  Computational
•  Applied
•  High Energy & Particle
•  Astrophysics