Lead Data Engineer

We are looking for a highly technical and hands -on Lead Data Engineer to lead the design, development, and modernization of enterprise data platforms. The successful candidate will be responsible for rebuilding data pipelines, integrating SAP and other enterprise systems, developing scalable data models, and driving best practices across the data engineering function.

This role requires a strong technical leader who remains actively involved in architecture, development, and delivery while mentoring and guiding engineering teams.

Requirements

Key Responsibilities

• Lead the design, development, and optimization of enterprise data platforms and pipelines.
  
• Rebuild and modernize existing ETL/ELT processes and data integration frameworks.
  
• Design and implement scalable solutions using Databricks and modern data architectures.
  
• Develop and maintain enterprise data models for reporting, analytics, and business intelligence.
  
• Lead integrations between SAP and other internal and external systems.
  
• Ensure data quality, reliability, performance, and governance across the data landscape.
  
• Provide technical leadership, mentorship, and guidance to Data Engineers.
  
• Collaborate with business and technical stakeholders to translate requirements into scalable solutions.
  

Required Experience

• 8+ years of Data Engineering experience.
  
• Proven experience in a Lead or Senior Data Engineering role.
  
• Strong hands -on experience with Databricks, Spark, Python, and SQL.
  
• Extensive experience rebuilding and optimizing enterprise data pipelines.
  
• Strong background integrating SAP with data platforms and downstream systems.
  
• Experience designing and implementing scalable data models.
  
• Experience working within cloud environments such as Azure or AWS.
  
• Strong understanding of data warehousing, data lakes, and modern data architectures.
  

Technical Skills

Essential

• Databricks
  
• Apache Spark / PySpark
  
• Python
  
• SQL
  
• Data Modelling
  
• ETL / ELT Development
  
• SAP Data Integration
  
• Azure or AWS Data Services
  
• Data Warehousing & Data Lakes
  
• API Integrations
  
• Git / CI/CD
  

Advantageous

• Microsoft Fabric
  
• Azure Data Factory
  
• Synapse Analytics
  
• Kafka
  
• Power BI
  
• Terraform