Senior Data Engineer (Temporary Project - Must Have Visa)

PLEASE APPLY ONLY IF YOU HAVE A UAE RESIDENT VISA AND NOT CURRENTLY EMPLOYED

We're looking for a Data Engineer for an up to 6 months ON SITE project in Abu Dhabi. The candidate must have their own residency visa.

• Important Skills:

Programming skills: Python and SQL

Strong API development from scratch

Strong skills in managing the data warehouse cloud.

Knowledge with creating / debugging stored procedures, SQL statements, views, triggers, and functions for Azure/MS SQL Server

Experience with Database administration: Azure/MS SQL Server and MS Azure Cloud

Must be well familiar with Visual Studio and Team Foundation ServerGitHub.

Data Modeling expertise is important: Tools such as Erwin

Strong skills in deploying ML models solutions in the cloud

Knowledge with with MDM solutions & customer profiling

• Skills considered as a PLUS:

Experience with machine learning algorithms (python, Databricks and/or Azure ML)

• Important Experience:

At least 5 years of experience with:

ETL development using Talend / Airflow,

developing SQL queries, stored procedures, and views

At least 3 years of experience with:

developing/coding in Python

database administration

working with any cloud solutions

• Expertise as a PLUS:

At least 3 years of experience with Azure Databricks or any cloud data warehouse such as (Snowflake, redshift)

At least 2 years experience of Azure DF

Must well understand ETL methodologies, Big Data and Data Warehousing principles, approaches, technologies, and architectures including the concepts, designs, and usage of data warehouses

Works with teams to understand, document, design, develop, code, and test ETL processes. Also, write, implement, and maintain appropriate ETL processes

Demonstrate experience with ETL design and options to improve load and extract performance

Translate source to target mapping documents into ETL processes

Build and integrating APIs

Deploy ML solutions in the cloud

Design, Develop, Test, Optimize and Deploy ETL code and stored procedures to perform all ETL related functions.

Works in Agile environment and utilizes best principles of CI/CD and DevOps

Design Big Data model

Responsible to design, implement and manage ETL processes using Talend and Azure Data Factory and administer and maintain the Azure/MS SQL server Databases and Microsoft Enterprise Data warehouse

Develop Spark Job in Scala or Java

Designs, codes in Python and SQL, orchestrates and monitors jobs in Azure Databricks / Snowflake or any data warehouse cloud

Qualifications:

· Bachelor's Degree in Computer Science, Engineering, or a related field

As a PLUS:

· Advanced certification in Azure (Azure DF, Azure ML)

· Certification in Azure Databricks or any cloud warehouse

· Any certification in data science is a big plus.