Data Engineering Lead

What you will do

•   Guide and develop a high-performing Data Engineering team, fostering a culture of innovation, efficiency, and collaboration.

•   Apply your deep expertise in Azure Data Platform and other Data Engineering tools to refine and expand our data capabilities

•   Lead the end-to-end process of designing, documenting, developing, implementing, and testing innovative prototypes that showcase the value of data

•   Oversee the development and integration of Web Apps, Function Apps, and custom user interfaces, ensuring robust data modelling, quality, governance, and security practices.

•   Serve as the primary contact for all Data Engineering inquiries

Skills

Required Skills to be successful

•   Practical experience in constructing and refining Big Data pipelines, architectures, and datasets, optimizing for efficiency and scalability.

•   Strong analytical skills , expertise with DevOps for deploying data pipelines

•   Knowledge of Data Virtualization Tools (Denodo), Auto ML Tools (DataRobot, Dataiku), Marketing Tools (Salesforce, etc.), SAP (BW/BO /ERP).

•   Expertise in Azure Data Factory, Databricks, Event Hubs, Python, PySpark, SQL & No-SQL Databases, and other pivotal Big Data solutions, ensuring robust, scalable data infrastructure.

What equips you for the role

•   Bachelor’s degree in computer science or a related field of study.

•   15+ years of IT experience in implementing complex business / transformation projects across various domains and managing internal and external teams.

•   Minimum 8+ years of practical experience building and managing data pipelines with multiple source system integrations

•   Minimum 4+ years of dedicated experience in the design, development, and management of web-based data management portals and tools

•   Minimum 3+ years of experience in building and managing real-time event streaming solutions using Kafka

•   Minimum 2+ years of experience in integrating Recommendation Engine or Segmentations with customer touchpoints / channels.