Azure Data Engineer

Job Description

Role Purpose

Data Engineering – Cloud Migration / ETL / Transformation  

Below are the technical skills, experience, and responsibilities related to the Offshore Data Engineering Role - emphasizing proficiency in Cloud migration, ETL processes and transformation of data. 

Basic Qualifications:

• Data Engineering: Proficiency with Azure Data Suite (Gen2 Storage, ADF, Synapse, etc.), Autosys, Confluence, Copilot, Databricks, Dragonboat, MergeMind, PractiTest, Parquet, Python, Pyspark, source code control (i.e. GitHub), creation of features/epics/stories using Jira, Informatica/IDMC, Manta, Airflow, Amazon Warehouse Servicing (AWS), and Agile methodology.

• Qualitative: Curious mindset with the ability to reverse engineer issues to determine root cause.  Experience in performance optimization, data governance, data architecture, data harmonization, and data history/retention; Demonstrated ability to work effectively and collaboratively with customers and team members across multiple locations. Strong communication and collaboration skills are emphasized.

• Educational and Job History: Three to five years of relevant experience, preferably a bachelor’s degree in computer science or MIS, with a master’s degree (preferred). Working knowledge in Mortgage Servicing, Consumer Lending, Claims, or Contact Center environments is advantageous.

• Project and Collaboration: Involves identification, design, development, and implementation of projects, working with internal teams including DBA, data source, and engineering teams. Responsibilities include project tracking, testing, documentation, and ensuring compliance with company standards.  Ability to work with internal risk, compliance, and regulatory groups. Excellent analytic skills with the ability to extract, collect, organize, analyze and interpret trends or patterns in complex data sets 

• Production Support and Tools: Proficient in SQL, SSIS, SSRS, and administration of SQL Server environments.  Familiarity with ETL processes, Visual Basic, C#, Monarch Modeling, and Microsoft Office (Excel, Word, PowerPoint, Access).  Experience with performance testing, issue remediation, and working with mainframe and Visual Basic programs.

͏

Data Engineering – Cloud Migration / ETL / Transformation  

Below are the technical skills, experience, and responsibilities related to the Offshore Data Engineering Role - emphasizing proficiency in Cloud migration, ETL processes and transformation of data. 

Basic Qualifications:

• Data Engineering: Proficiency with Azure Data Suite (Gen2 Storage, ADF, Synapse, etc.), Autosys, Confluence, Copilot, Databricks, Dragonboat, MergeMind, PractiTest, Parquet, Python, Pyspark, source code control (i.e. GitHub), creation of features/epics/stories using Jira, Informatica/IDMC, Manta, Airflow, Amazon Warehouse Servicing (AWS), and Agile methodology.

• Qualitative: Curious mindset with the ability to reverse engineer issues to determine root cause.  Experience in performance optimization, data governance, data architecture, data harmonization, and data history/retention; Demonstrated ability to work effectively and collaboratively with customers and team members across multiple locations. Strong communication and collaboration skills are emphasized.

• Educational and Job History: Three to five years of relevant experience, preferably a bachelor’s degree in computer science or MIS, with a master’s degree (preferred). Working knowledge in Mortgage Servicing, Consumer Lending, Claims, or Contact Center environments is advantageous.

• Project and Collaboration: Involves identification, design, development, and implementation of projects, working with internal teams including DBA, data source, and engineering teams. Responsibilities include project tracking, testing, documentation, and ensuring compliance with company standards.  Ability to work with internal risk, compliance, and regulatory groups. Excellent analytic skills with the ability to extract, collect, organize, analyze and interpret trends or patterns in complex data sets 

• Production Support and Tools: Proficient in SQL, SSIS, SSRS, and administration of SQL Server environments.  Familiarity with ETL processes, Visual Basic, C#, Monarch Modeling, and Microsoft Office (Excel, Word, PowerPoint, Access).  Experience with performance testing, issue remediation, and working with mainframe and Visual Basic programs.

͏

2. Perform coding and ensure optimal software/ module development

• Determine operational feasibility by evaluating analysis, problem definition, requirements, software development and proposed software


• Develop and automate processes for software validation by setting up and designing test cases/scenarios/usage cases, and executing these cases


• Modifying software to fix errors, adapt it to new hardware, improve its performance, or upgrade interfaces.


• Analyzing information to recommend and plan the installation of new systems or modifications of an existing system


• Ensuring that code is error free or has no bugs and test failure


• Preparing reports on programming project specifications, activities and status


• Ensure all the codes are raised as per the norm defined for project / program / account with clear description and replication patterns


• Compile timely, comprehensive and accurate documentation and reports as requested


• Coordinating with the team on daily project status and progress and documenting it


• Providing feedback on usability and serviceability, trace the result to quality risk and report it to concerned stakeholders

͏

3. Status Reporting and Customer Focus on an ongoing basis with respect to project and its execution

• Capturing all the requirements and clarifications from the client for better quality work


• Taking feedback on the regular basis to ensure smooth and on time delivery


• Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members.


• Consulting with engineering staff to evaluate software-hardware interfaces and develop specifications and performance requirements


• Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code


• Documenting very necessary details and reports in a formal way for proper understanding of software from client proposal to implementation


• Ensure good quality of interaction with customer w.r.t. e-mail content, fault report tracking, voice calls, business etiquette etc


• Timely Response to customer requests and no instances of complaints either internally or externally

͏

Deliver