Expert Java/Scala Consultant with Spark

Type of contract: B2B contract

Salary range: 155 - 205 PLN/H

What will you do?

You will join a global agile team responsible for building and enhancing data processing and storage solutions that support risk management and surveillance capabilities. Working closely with Product Owners, Analysts, Architects, Data Scientists, and Engineers, you will contribute to the development of scalable big data solutions and help deliver key strategic initiatives within a highly regulated financial environment.

Your tasks

• Work with Product Owners and IT Analysts to understand business and stakeholder requirements


• Build and manage data processing components and storage technologies


• Onboard new data sources and develop data processing pipelines


• Prepare and deliver data views required by application development teams


• Collaborate with Data Scientists to productionise analytics solutions


• Develop software in line with continuous integration and test-driven development principles


• Validate technical designs and ensure adherence to architectural standards


• Perform unit testing and maintain high code quality standards

Requirements

• Practical experience with Apache Spark


• Strong programming experience using Java and/or Scala


• Experience building and maintaining ETL solutions


• Experience working with big data processing technologies


• Strong communication skills in English


• Openness to work hybrid from our client's office (Kraków) 8 days a month

Nice to have

• Experience with Apache Hadoop (YARN, HDFS)


• Experience with Spring Framework


• Knowledge of Apache Airflow


• Experience with SQL databases


• Experience with Elasticsearch


• Experience with Python


• Experience deploying services on Google Cloud Platform


• Knowledge of Maven


• Knowledge of Git


• Experience working in Agile environments