Senior Data Consultant (Python, GCP, Airflow)

Contract type: B2B

Salary range: 125-163 PLN/h

What will you do?

You will join a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing robust data pipelines, developing data models, and ensuring reliable and high-quality data for business decision-making. You will collaborate with cross-functional teams to deliver efficient and maintainable data architecture.

Your tasks:

• Design, develop, and maintain scalable data pipelines and ETL processes


• Build and manage Apache Airflow DAGs for workflow orchestration


• Develop data processing logic using Python and frameworks like DBT or Spark


• Work with BigQuery and Cloud SQL to store and transform data


• Implement and maintain data architecture and data models


• Ensure data quality, integrity, and reliability


• Collaborate with business stakeholders to translate requirements into data solutions


• Maintain technical documentation and contribute to data standards


• Support deployment and monitoring of pipelines in GCP environments


• Participate in code reviews and improve engineering best practices

Requirements:

• Strong proficiency in Python for backend or data processing


• Hands-on experience with Google Cloud Platform including BigQuery, Cloud Storage, Compute Engine or GKE


• Experience with Apache Airflow for workflow orchestration


• Strong experience with ETL and data integration pipelines


• Experience with Spark


• Knowledge of NoSQL databases


• Strong knowledge of relational databases


• Strong understanding of data architecture


• Good understanding of data quality


• Strong understanding of data integration


• Openness to work 2 days a week from our client's office (Kraków)

Nice to have skills:

• Familiarity with Apache Beam