Number of Applicants
:000+
Let AI Supercharge Your Job Hunt!
JobCopilot scans 500,000+ company career sites daily to find jobs for you
About the Role
Design, build, and maintain scalable data pipelines and data platforms
Work hands\-on with Python, PySpark, SQL, and Spark to deliver reliable data solutions
Collaborate with cross\-functional teams while working independently to meet delivery goals
Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL/ELT processes
Build and optimize large\-scale data processing systems using Spark/PySpark
Develop efficient and complex SQL queries for data extraction and transformation
Ensure data quality, integrity, and consistency across systems
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
Monitor, troubleshoot, and optimize data workflows and performance issues
Implement data validation, error handling, and logging mechanisms
Work with structured and unstructured data from multiple sources
Maintain documentation for data architecture, pipelines, and processes
Participate in code reviews and follow best coding practices
Required Skills & Qualifications
Minimum 5+ years of experience in Data Engineering or related roles
Strong proficiency in Python / PySpark
Advanced knowledge of SQL and database concepts
Hands\-on experience with Apache Spark
Solid data analysis and problem\-solving skills
Excellent communication skills (written and verbal)
Ability to work independently and manage tasks effectively
Understanding of data warehousing concepts and ETL methodologies
Experience with version control systems such as Git
Good to Have (Preferred Skills)
Experience with cloud platforms (AWS recommended)
Knowledge of big data technologies such as Hadoop, Hive, or Kafka
Exposure to orchestration tools like Airflow or similar
Experience with data modeling and schema design
Familiarity with CI/CD pipelines and DevOps practices
Understanding of data security and governance principles
Soft Skills
Strong analytical and critical\-thinking abilities
Effective collaboration and teamwork skills
Self\-motivated with strong ownership mindset
Ability to manage multiple priorities in a fast\-paced environment
Experience working in Agile/Scrum development teams
Apply by sending your CV to [email protected]