Spark Scala Developer - Hybrid / Leeds - £450-£550

Spark Scala Developer - Scala / Apache Spark - Hybrid / Leeds - £450-£550
Spark Scala Developer to join our client, one of the biggest financial services organizations in the world, with operations in more than 38 countries. It has an IT infrastructure of 200,000+ servers, 20,000+ database instances, and over 150 PB of data.
As a Spark Scala Engineer, you will have the responsibility to refactor Legacy ETL code, for example DataStage into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues.
Your responsibilities;
As a

Spark Scala Engineer you will be working for the GDT (Global Data Technology) Team,

you will be responsible for:
Designing, building, and maintaining data pipelines using Apache Spark and Scala
Working on an Enterprise scale Cloud infrastructure and Cloud Services in one of the Clouds (GCP).
Mandatory Skills;
At least 8+ Years of IT Experience with

designing, building, and maintaining data pipelines .
At least 4+ Years of experience with

designing, building, and maintaining data pipelines using Apache Spark and Scala.
Programming languages: Proficiency in Scala and Spark is essential. Familiarity with Python and SQL is often a plus.
Big Data technologies: Understanding of HDFS,...