Overview:
We are looking for a QA Engineer with 2–6 years of experience in software testing, with a
focus on validating AI/ML models, data pipelines, and AI -driven applications. The
ideal candidate should have strong automation skills, good understanding of ML
workflows, and experience testing AI systems.
Key Responsibilities:
Test AI/ML models for accuracy, consistency, fairness, drift, and quality.
Validate datasets, data pipelines, and model outputs.
Create and execute automated test scripts (Python preferred) for APIs, UI, and
model inference.
Perform performance and reliability testing of AI services (latency, throughput,
scalability).
Identify defects, report issues, and drive quality improvements.
Work with ML engineers, data scientists, and product teams to understand
requirements and define test scenarios.
Maintain test plans, cases, and documentation.
Requirements
Skills & Qualifications:
2–6 years of QA/testing experience.
Hands -on experience with Python, automated testing, and QA tools (PyTest,
Postman, Robot Framework, etc.).
Basic understanding of ML models, LLMs, NLP/CV systems, and evaluation
metrics.
Experience in API testing and CI/CD integration.
Strong analytical, communication, and problem -solving skills.
Good -to -Have:
Experience with MLflow, Airflow, MLOps tools.
Knowledge of LLM testing frameworks (Evals, Ragas, LangSmith).
Exposure to vector databases or cloud platforms.