Lead Data Engineer

Job Description
About The Company:

iLink is a Global Software Solution Provider and Systems Integrator, delivers next-generation technology solutions to help clients solve complex business challenges, improve organizational effectiveness, increase business productivity, realize sustainable enterprise value and transform your business inside-out. iLink integrates software systems and develops custom applications, components, and frameworks on the latest platforms for IT departments, commercial accounts, application services providers (ASP) and independent software vendors (ISV). iLink solutions are used in a broad range of industries and functions, including healthcare, telecom, government, oil and gas, education, and life sciences. iLink's expertise includes Cloud Computing & Application Modernization, Data Management & Analytics, Enterprise Mobility, Portal, collaboration & Social Employee Engagement, Embedded Systems and User Experience design etc.

What makes iLink Systems' offerings unique is the fact that we use pre-created frameworks, designed to accelerate software development and implementation of business processes for our clients. iLink has over 60 frameworks (solution accelerators), both industry-specific and horizontal, that can be easily customized and enhanced to meet your current business challenges.

Requirements

12+ years of experience in Design, Development of Azure data lake, Azure Data Factory with Python/PySpark .
Experience in handling large volume of data in CosmosDB, SQL server.
Hands on experience in working on large data conversion/migration projects.
Strong ETL expertise to handle incremental load, SCDs, archival, encryption of the files/data.
Experience in Azure services - Function App, Key Vault, Event Hub is advantage
Strong experience working with SQL/SparkSQL queries, PySpark scripting and delta lake approach.
Excellent in impact-analysis and root cause analysis.
Helping teams build CI/CD pipeline
Benefits Competitive salaries
Medical, Dental, Vision Insurance
Disability, Life & AD&D Insurance
401K With Generous Company Match
Paid Vacation and Personal Leave
Pre-Paid Commute Options
Employee Referral Bonuses
Performance Based Bonuses
Flexible Work Options & Fun Culture
Continuing Education Reimbursements
In-House Technology Training