Azure Data Engineer - Senior

HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies.

At HTC Global Services our consultants have access to a comprehensive benefits package. Benefits can include Paid-Time-Off, Paid Holidays, 401K matching, Life and Accidental Death Insurance, Short & Long Term Disability Insurance, and a variety of other perks.

Job Description:

In your role as an Azure Data Engineer, you will be responsible for expanding and optimising data and pipeline architectures, and for optimising data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data delivery architecture is put in place throughout ongoing projects.

Job Responsibilities

Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements
Develop and maintain innovative Azure solutions
Solution design using Microsoft Azure services and other tools
The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
Build data pipelines to collectively bring together data
Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse
Tech Stack

Python
SQL and NoSQL databases
Scala
Spark-SQL
Experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates
Required Skills/ Qualifications

10+ Years of Data Experince with Data Bricks experience is required.
Previous experience as an Azure Data Engineer or similar role
Experience building and optimising 'big data' data pipelines, architectures, and data sets
Strong analytic skills related to working with unstructured datasets
The ability to design and implement well written code
Ability to work to tight deadlines
Ability to test the data from source to the presentation layer
Ability to support/troubleshoot data pipelines
Confident and concise communication skills, with the ability to drive alignment, collaboration, and efficiency.