Number of Applicants
:000+
Let AI Supercharge Your Job Hunt!
JobCopilot scans 500,000+ company career sites daily to find jobs for you
Key Responsibilities
● Develop Test Strategy: Create a comprehensive test plan for the Lakehouse, focusing on Data Integrity, Accuracy, and Consistency.
● Automate Validation: Replace manual "spot-checking" with automated Python test suites that run as part of the CI/CD pipeline.
● Defect Analysis: Identify and document data anomalies, working closely with Data Engineers to perform root-cause analysis on Spark job failures.
● Regression Testing: Ensure that new PySpark code deployments do not impact existing Gold layer business logic or dashboard reporting.
ExperienceRequirements
● Total QA/Testing Experience: 5+ years.
● Data Testing Experience: 3+ years specifically in Big Data, Hadoop, or CloudData Warehouse environments.
● Good to have : Databricks Experience: 1+ years of experience testingpipelines within a Databricks environment.
●
Automation
Focus: Proven track record of moving from manual SQL checks to automated Python-based testing frameworks.
● Migration automation test experience using Python
Required Certifications
● Good to have: Databricks Certified Data Engineer Associate (at minimum).
● Preferred: ISTQB Foundation or Advanced Level (Test Automation Engineer).
Auto-Apply to Similar Jobs with your AI JobCopilot
Copyright © 2026 Grabjobs Pte.Ltd. All Rights Reserved.