Data Engineer

The Job

As a Data Engineer, you will be working in the Red Engine technology team, helping to build out the existing data and analytics platform. This role is placed within a small team, allowingthe successful candidate design freedom in implementing bespoke features and enhancements to our data platform using the latest technology. In this role you will assist the senior engineers in meeting with keybusiness stakeholders to gather technical requirementsto drive thedesign and implementation ofdata solutions within the Data & Analytics platform.

Key responsibilities will include:

• Develop and maintaindata pipelines toorchestrate the ingestion of data from disparate source systems into a centralised data analytics platform.

• Design and implement data engineering solutions using T-SQL and Pythonin the Azure cloud environment.

• Work with Data Analysts in promoting business logic into the analytics platform, to support business reports and dashboards.

• Maintain and leverageCI/CD deployment pipelines to promote application code into higher tier environments.

To be successful in this role, you'll have:

• Demonstrated experience developing ELT/ETL ingestion pipelines to handle data movement and transformation from structured and unstructured data sources.

• Experience with the Azure cloud platform including:

• Data Ingestion: Azure Data Factory (ADF), Databricks, Logic Apps, Azure Functions

• Data storage: ADLS, SQL Server and Unity Catalog (Medallion Architecture).

• Data Analysis: Databricks notebooks, SQL queries, data visualisations (PowerBi or adjacent tools)

• Stong understanding of the Databricks platform including managing, developing, and deploying workflows, jobs, and notebooks.

• Proven experience in modelling data in a data warehouse using Inmon or Kimball approaches.

• Experience in database development in SQL Server including developing stored procedures, functions, and views.

• Experience working in an Agile software development framework.

• Experience with Data Build Tool (DBT) including building data models, tests, validation, and transformations.

• Thorough understanding of districted file and table format (i.e., Parquet, Delta, Iceberg, Hudi)

Preferred

• Experience with IaC solutions using Terraform, Pulumi or similar tools.

• Experience working with modern CI/CD DevOps frameworks.

• Experience in developing data visualisations usingPowerBi, Tableau or similar tools.

What you'll get

• Competitive pay
• Annual bonus
• 33 days annual leave inclusive of Bank Holidays
• Fusion working (our team are regularly in our venues, working collaboratively in our bright offices in Angel, or focusing on individual projects with work from home Thursdays)
• Staff discount in all venues (50% off Sunday, Monday, 25% off Tuesday - Saturday, and free game hire)
• Private healthcare
• Regular team socials and weekly lunch in venue
• Monthly learning and development classes, quarterly teambuilding events
• Summer and Christmas socials
• Help @ hand 24/7 health support
• Free access to therapy, nutritionists, and physiotherapists

Here at Red Engine, we believe our success begins and ends with our people. We are committed to a diverse culture where all our team feel respected and included. We acknowledge the power that a diverse set of beliefs and perspectives can bring, and that a variety of voices strengthens our team, enhances creativity, and drives innovation. We welcome applications from candidates of all identities, including individuals of different races, ethnicities, genders and sexual orientations. If you're passionate about contributing to a culture of inclusion and collaboration, please apply.