M21 - Data Engineer

Overview

As a Data Engineer, you will be assisting in the maintenance and support data products. You will be working closely with our divisions on their needs to leverage data for strategy formulation, policy implementation and decision making.

The work streams that you could be involved include:

• Data Science: You will work closely with our Data Scientist(s) to procure and prepare the data, and to convert them into operating models for businesses' day-to-day use
• Business Intelligence: You will assist in the integration and structuring of data from various sources to create interactive, real-time dashboards for decision making.
• Data Architecture and Governance: You will assist in defining scalable data architecture for analytics and reporting needs, building data pipelines and related elements of the architecture, and developing the governance to ensure data quality.

Your roles and responsibilities would include the following:

• Support the daily operations of the data platform (e.g. handling error notifications, job monitoring & recovery, testing data pipelines);
• Investigate and troubleshoot reported incidents related to technical setup (e.g. connectivity failure, API timeout, service failure);
• Document changes to existing setup (e.g. data sources, pipelines, accounts);
• Research, propose and document technical requirements;
• Review and implement fixes for reported security vulnerabilities;
• Collaborate with the infrastructure team on the data team requests;
• Support product managers in cloud transformation journey for data products;
• Provide technical support and consultancy to business users;
• Develop reports to monitor usage, performance and security events;
• Generate mockup data and create unit tests;
• Set up DevOps pipelines;
• Optimise performance of data pipelines;
• Review data pipelines to ensure adherence to data management standards, policies and procedures.

Requirements

To meet the challenges of this role, you must have/ be:

• Minimum of Bachelor's Degree in Computer Science, Computer Engineering, or related disciplines;
• 3-5 years of work experience in Data Engineering, Data Science, Software Engineering or IT Infrastructure
• Proficient in developing dashboards (preferably with QuickSight or Tableau);
• Proficient in dashboard UX design;
• Proficient in SQL scripting to analyze, transform and integrate data sources;
• Proficient in Python;
• Ability to work effectively under time constraints and potentially changing priorities, while maintaining a high level of attention to details

Good to haves:

• Experience IT infrastructure (server, database, network administration experience is an advantage);
• Experience or certification in Tableau Server administration;
• Experience or certification in Talend administration;
• Experience or certification in MS SQL Server administration;
• Experience or certification in SAS Viya administration;
• Proficient in PowerShell;
• Experience in AWS or cloud services;
• Experience in SHIP-HATS or DevOps tools;
• Experience in Terraform or IaC;
• Experience with agile or other rapid application development methodologies