Tech Lead Data Consultant

Type of contract: B2B contract

Salary range: 155-205 PLN/H

What will you do?

Join a strategic data transformation initiative focused on building and enhancing a large-scale data pipeline that feeds and reconciles inbound data from deal stores to consumer regulatory and settlement systems. You will work on modernizing enterprise-grade financial services platforms within a highly regulated environment, leveraging cloud-native technologies, big data solutions, and distributed streaming architectures. The role involves designing high-performance systems, improving data processing capabilities, and collaborating closely with technical and business stakeholders.

Your tasks

• Design and develop scalable data processing solutions using Spark and Databricks


• Build and enhance data pipelines using PySpark, Python and Java


• Develop high-performance, high-availability distributed systems


• Implement and maintain streaming solutions based on Kafka architectures


• Design and optimize cloud-native solutions in Microsoft Azure


• Support CI/CD processes and DevOps practices


• Collaborate with cross-functional Agile teams to deliver business requirements


• Analyze complex technical flows and propose suitable technical solutions


• Participate in system modernization and application transformation initiatives


• Ensure reliability, scalability and performance of data platforms

Requirements

• 7+ years of professional software engineering or data engineering experience


• Strong experience with Spark and Databricks


• Hands-on experience with PySpark


• Strong Python programming skills


• Good Java development experience


• Deep knowledge of Microsoft Azure cloud technologies


• Experience with Kubernetes


• Experience designing and implementing Kafka-based streaming solutions


• Experience with DevOps practices and CI/CD pipelines


• Experience building distributed, high-throughput and low-latency systems


• Strong problem-solving and analytical skills


• Ability to work independently on complex technical challenges


• Excellent communication and stakeholder management skills


• Experience working in Agile teams


• Openness to work hybrid from our client's office (Kraków) 3 days a week

Nice to have

• Experience providing Level 3 (DEV) production support in a high-pressure environment