Senior Data Engineer

• Design, develop, and optimize scalable data pipelines using tools and technologies like Airflow, AWS Glue, AWS Redshift, AWS DataZone etc.
  
• Build and maintain ETL processes for data ingestion, transformation, and integration from various sources.
  
• Design and implement data warehousing solutions (e.g. Redshift) for high performance analytics.
  
• Ensure data quality and integrity through robust data validation, cleaning, and transformation techniques.
  

• Architect and manage cloud -based data platforms using AWS.
  
• Develop infrastructure -as -code (IaC) using tools like Terraform, CloudFormation and using our Cloud Native Data Platform.
  
• Implement CI/CD pipelines for automated deployment of data pipelines and infrastructure updates.
  
• Monitor and optimize cloud resources for performance, cost efficiency, and scalability.
  

• Work closely with data scientists, analysts and enterprise architects to align data architecture with business needs.
  
• Mentor junior data engineers and provide technical guidance on best practices and emerging technologies.
  
• Collaborate with DevOps and IT teams to ensure secure, scalable and high -availability data systems.
  

• Implement data governance practices, including data lineage, cataloging and role based access control. Ensure compliance with data privacy regulations (e.g. POPIA, ) and internal security policies.
  
• Perform regular audits and optimize data storage and processing for cost and efficiency.
  

Requirements

• Bachelor’s degree in computer science, Data Science, Engineering or a related field.
  
• Master’s degree preferred
  
• Majors in Mathematics and Statistics (an Advantage)
  

• 5+ years of experience as a data engineer, with at least 2 years in a senior role.
  
• A minimum of 5+ years of experience in AWS technologies/services (AWS Redshift)
  
• Proven experience in DevOps practices including CI/CD pipelines, IaC, and cloud automation.
  
• Appropriate exposure and experience in Data Mesh (theoretical and practical)
  
• Proficiency in SQL and NoSQL databases.
  
• Excellent problem solving, analytical and communication skills.
  

• Experience in the Financial, Banking, FinTech or Retail industry in a senior data Engineering role
  
• Experience in Agile work practices
  
• Certified AWS professional
  
• Knowledge of stream processing frameworks