We're looking for a seasoned technical leader and Principal Scala Engineer to drive the modernization and evolution of our core data processing platforms. This role is central to re-architecting high-traffic, mission-critical data pipelines, moving them to a more robust, scalable, and efficient future on the Google Cloud Platform (GCP).
You will be instrumental in defining the technical strategy for our Scala-based Dataflow processing, ensuring reliability and performance at scale. This is a hands-on leadership role for someone who thrives on solving complex distributed systems problems, confidently leading a group of engineers, and mentoring a team to deliver excellence.
Lead the architectural design and technical roadmap for modernizing and scaling our data ingestion and processing pipelines, primarily using Scala and GCP Dataflow (Apache Beam).
Drive performance and throughput enhancements, such as migrating services to use Cloud Functions for exporting data from BigQuery to Pub/Sub more efficiently than existing Dataflow jobs.
Partner with Staff Engineers to expand the functionality of our data export systems for external partners. This involves pulling data from BigQuery, creating formatted feed files, and exporting them to various external stores (e.g., FTP, GCS, S3).
Oversee the support and expansion of existing data integrations, including adding new fields to schemas and ensuring that data is propagated correctly through the entire pipeline.
Drive the refactoring and modernization of legacy Scala codebases, introducing best practices in functional programming, testing, and observability.
Collaborate closely with teams using Node.js APIs (for data ingestion) and Python (for data transformations), defining clear data contracts and robust integration patterns.
Mentor and guide a team of engineers, championing engineering best practices, conducting code reviews, and fostering a culture of high-quality, collaborative development.
Act as a key technical communicator, defining approaches, breaking down complex problems, and engaging in rapid, iterative development cycles by asking questions quickly rather than working in isolation.
This role is designed for impact, and we believe our best work happens when we connect. While we operate a flexible model, we expect you to spend time on site (at our offices or a client location) for collaboration sessions, customer meetings, and internal workshops.
Degree in Computer Science or a related technical discipline.
8 + Extensive experience of software engineering, with experience, with a proven track record of designing, building, and operating large-scale, high-traffic distributed systems in production.
Deep expertise in Scala and its functional programming paradigms.
Demonstrable, hands-on experience with GCP Dataflow (Apache Beam). Experience with other major streaming/batch frameworks (e.g., Apache Spark, Akka Streams) is also highly valuable.
Strong proficiency in the GCP ecosystem, including critical services like BigQuery, Pub/Sub, and Cloud Functions.
Solid understanding of data engineering principles, including data modeling, schema design, and data lifecycle management.
Experience building and maintaining data export feeds to external systems (e.g., SFTP, GCS, S3).
Proven ability to lead technical projects, mentor other engineers, and influence architectural decisions across multiple teams.
Excellent communication skills, with experience working in polyglot environments (interfacing with Node.js, Python, etc.) and a proactive, inquisitive approach to problem-solving.
Ability to be available for key synchronous meetings and standups between 4:00 - 6:00 PM UK time.
Nice to Have
Familiarity with CI/CD best practices and infrastructure-as-code tools (e.g., Terraform, Docker, Kubernetes).
Working knowledge of Node.js or Python for data-related tasks.
Experience with other data stores (e.g., NoSQL, time-series databases) or data orchestration tools (e.g., Airflow).
Culture and Environment
We are a team of passionate people who genuinely care about what they do and the standard of work they produce.
Collaborate with our two hubs in Portugal: Lisbon and Porto.
A strong company culture that includes weekly meetings, company updates, team socials, and celebrations.
In-house DE&I council and mental health first-aiders.
Time Off and Well-being
25 days’ annual leave, Juneteenth, your birthday off, and a paid office closure between Christmas and New Year's.
Health insurance.
15 days of paid sickness and wellness days.
Growth and Development
A generous learning and development budget and an annual leadership development programme.
Diversity and Inclusion
At Qodea, we champion diversity and inclusion. We believe that a career in IT should be open to everyone, regardless of race, ethnicity, gender, age, sexual orientation, disability, or neurotype. We value the unique talents and perspectives that each individual brings to our team, and we strive to create a fair and accessible hiring process for all.
Todos os Anúncios de Emprego estão sujeitos aos Terms of Service do GrabJobs. Permitimos que os usuários marquem postagens que possam estar em violação desses termos. Anúncios de emprego também podem ser marcados pela equipe de moderação do GrabJobs. No entanto, nenhum sistema de moderação é perfeito, e marcar uma postagem não garante que ela será removida.
Seja o primeiro a receber as últimas vagas Others Full-Time em Portugal.
Setup your job alert:
Ao ativar os alertas de emprego, eu concordo com os Terms & Privacy Policy do GrabJobs. Posso cancelar a inscrição nos alertas de emprego a qualquer momento.
Pular
Você atingiu seu número máximo de alertas de emprego.
O GrabJobs é o portal de empregos número 1 em Portugal, conectando você rapidamente a milhares de empregos de !
Encontre os melhores empregos de em Portugal, candidate-se com apenas 1 clique e consiga um emprego hoje!