Lead Data Engineer

Job DescriptionWould you like the opportunity to work at the cutting edge of cloud-first technologies and contribute to the development and support of new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. £51,997 - £80,400. 27% employer pension contribution and other benefits. Flexible, hybrid working from Swansea with options for condensed hours.You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise their digital services.This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions.Responsibilities:Leadership and Strategy: Lead the data engineering team, setting standards and best practices. Contribute to the strategic direction of the data infrastructure and analytics capabilities.Data Architecture: Design, build, and optimize scalable data pipelines and architectures on Azure and Databricks.Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.Innovation: Stay up-to-date with emerging technologies and industry trends to ensure our data architecture is state-of-the-art.Quality Assurance: Implement and oversee data quality processes to ensure accuracy, consistency, and reliability of data.Mentorship: Provide guidance and mentorship to junior data engineers, fostering a culture of continuous learning and improvement.Essential Skills: Technical Expertise: Extensive experience with Microsoft Azure and Databricks, including data storage, processing, and analytics.Programming Skills: Proficiency in Python, SQL, and other relevant programming languages.Big Data Technologies: Experience with big data technologies such as Apache Spark.Data Warehousing: Strong knowledge of data warehousing concepts and solutions.Problem-Solving: Excellent problem-solving skills with a detail-oriented approach.Leadership: Proven ability to lead and inspire a team of data engineers.Benefits:• Best in class learning and development tailored to your role.• An environment with flexible working options where they encourage a great work-life balance.• A culture encouraging inclusion and diversity with a range of staff communities to support all their colleagues.• Generous employer contribution of at least 26.6%, depending on rate of salary and chosen pension scheme.• Digital communities with clear career frameworks.• On-site gym plus personal training available.• On-site nursery, restaurants and coffee bar.• 25 days holiday (plus bank holidays), increasing by 1 each year (up to 30) & 1 extra day for the King’s birthday.• Free parking.• Ability to buy and sell annual leave.If you are a Lead Data Engineer looking to develop your skills and work with the latest technologies on large-scale software delivery projects, then contact Steve Wall at Inspire People or apply today.