Azure Data Engineer

• Help design, build and continuously improve the clients online platform.
  


• Research, suggest and implement new technology solutions following best practices/standards.
  


• Take responsibility for the resiliency and availability of different products.
  


• Be a productive member of the team.
  
  

Requirements

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF). Develop and implement data transformation solutions in Azure Databricks using PySpark and Python.
  


• Write, optimize, and tune complex SQL queries, stored procedures, and views for large\-scale data platforms.
  


• Implement robust data quality checks, monitoring, and logging mechanisms within data pipelines to ensure reliability and accuracy.
  


• Establish and manage CI/CD pipelines for data engineering solutions using Azure DevOps.
  


• Handle deployment and release management for ADF pipelines, Databricks notebooks, and SQL scripts.
  


• Implement version control, branching strategies, and environment management to support efficient and controlled development lifecycles.
  


• Deploy and manage Azure infrastructure components such as Azure Data Factory, Azure SQL, Event Grid, Virtual Networks (VNet), Key Vault, and Private Endpoints (PEP) using Bicep.
  


• Ensure secure, compliant, and well\-governed data platform deployments by following Azure security best practices and governance standards.
  

Benefits

• A challenging, innovating environment.
  


• Opportunities for learning where needed.