Help design, build and continuously improve the clients online platform.
Research, suggest and implement new technology solutions following best practices/standards.
Take responsibility for the resiliency and availability of different products.
Be a productive member of the team.
Requirements
Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF). Develop and implement data transformation solutions in Azure Databricks using PySpark and Python.
Write, optimize, and tune complex SQL queries, stored procedures, and views for large\-scale data platforms.
Implement robust data quality checks, monitoring, and logging mechanisms within data pipelines to ensure reliability and accuracy.
Establish and manage CI/CD pipelines for data engineering solutions using Azure DevOps.
Handle deployment and release management for ADF pipelines, Databricks notebooks, and SQL scripts.
Implement version control, branching strategies, and environment management to support efficient and controlled development lifecycles.
Deploy and manage Azure infrastructure components such as Azure Data Factory, Azure SQL, Event Grid, Virtual Networks (VNet), Key Vault, and Private Endpoints (PEP) using Bicep.
Ensure secure, compliant, and well\-governed data platform deployments by following Azure security best practices and governance standards.
