ETL Data testing

Title: ETL Data Testing

Location: Remote

Notice Period: (Immediate Joiner - Preferred)

Experience: 5+ Years

What youll do:

Key Responsibilities: 

• Select and integrate data tools and frameworks to provide requested capabilities. 
• Provide technical guidance to software engineers in designing, coding, reviewing, and testing enterprise software. 
• Collaborate with Data Scientists, Data Engineers, and Software Engineers to develop QA tests to validate data and models. 
• Implement ETL processes. Monitor performance and recommend infrastructure changes as needed. 
• Define data retention policies. 
• Collaborate with the recruitment team for hiring. 

Requirements: 

• Experience creating detailed and comprehensive test suites using Python.
• Proficiency in writing complex SQL queries for data extraction or validation.
• Strong understanding of Big Data concepts and NoSQL databases (preferred).
• Expertise in writing Hive QL and Spark QL queries. 
• Hands-on experience with data testing tools like DBT, iCEDQ, QuerySurge, Denodo, Informatica, etc. 
• Good understanding of QE testing types for data quality. 
• Experience in troubleshooting applications and managing the defect lifecycle. 
• Ability to test software and complete UAT in an Agile environment. 
• Expertise in continuous automation for increased test coverage and efficiency. 
• Proactive and reactive support in deployments and production environments.
• Proficiency in Linux or Unix environments. 
• Strong debugging skills. 
• Ability to resolve cluster operating issues. 
• Experience integrating data from multiple sources. 
• Knowledge of BI tools like Power BI and Tableau (preferred). 
• Experience with messaging systems like Kafka or RabbitMQ. 
• Strong analytical and excellent communication skills. 

Mandatory Skills: 

• Python Advanced SQL queries Big Data concepts NoSQL databases Hive QL, Spark QL 
• Data testing tools: DBT, iCEDQ, QuerySurge, Denodo, Informatica, etc.
• Linux or Unix 
• Messaging systems: Kafka or RabbitMQ 

Driving Results: 

• Good single contributor & good team player. 
• Flexible attitude towards work, as per the needs. 
• Proactively identify & communicate issues and risks. 

Other Personal Characteristics: 

Dynamic, engaging, self-reliant developer Ability to deal with ambiguity Manage a collaborative and analytical approach Self-confident and humble Open to continuous learning Intelligent, rigorous thinker who can operate successfully amongst bright people