(1728) Data Engineer - BSTD

Brief description

The main purpose of this position is to design, develop and maintain data pipelines to collect, store, transform and deliver organisational data to enable data domains and business domains within the South African Reserve Bank (SARB).

Detailed description

The successful candidate will be responsible for the following key performance areas:

• Design and develop data engineering standards, processes and frameworks to ensure optimised solutions and adherence to best practice.

• Develop, construct, test and maintain data pipeline architectures.

• Ensure interoperability of systems by designing and maintaining integration patterns (e.g. application programming interfaces), data exchange formats and integration protocols.

• Design and build data pipelines that are robust, modular, scalable, deployable, reproducible and versioned for data domains and business domains.

• Quality-assure data pipeline implementations to ensure adherence to data engineering frameworks and standards.

• Recommend ways to improve data reliability, efficiency and quality.

• Monitor and optimise domain-specific data pipelines to ensure reliable data availability and sustained performance over time.

• Develop and manage stakeholder relationships to promote data management across the organisation and support reliable decision-making and appropriate data usage.

• Maintain documentation for data pipelines, integration processes and interoperability standards.

• Manage data growth patterns to plan infrastructure needs, ensure compliance with retention frameworks and support responsible data-sharing.

• Enable and support the technical implementation of data management capabilities, including data governance, data quality, metadata management, master and reference data management, data architecture and data modelling, data security and privacy, data life cycle and retention management, data cataloguing and lineage, and analytics enablement.

Job requirements

To be considered for this position, candidates must be in possession of:

• a Bachelor’s degree (NQF 7) in Computer Science, Engineering, Information Management, Mathematics or Technology, or an equivalent qualification;

• at least five to seven years’ experience in the field of data engineering; and

• a relevant data engineering certification (would be an added advantage).

Additional requirements include:

• knowledge and skill in:
• industry, organisational and business awareness;
• continuous learning and/or professional development;

• quality assurance;

• information management;

• enterprise information management (EIM) strategy;

• data quality management;

• metadata management;

• data modelling and development;

• information governance;

• EIM legislation and governance, risk and compliance;

• extensive knowledge of best practices/methodologies in data warehousing and multi-dimensional data modelling (i.e. OLAP, e.g. ESSBASE or Microsoft Analysis Services), system design and management;

• extensive knowledge of the most common RDBMS technologies (e.g. Oracle, IBM, SQL Server and MySQL);

• experience in deploying and managing big data environments (e.g. Hadoop, Spark and NoSQL);

• experience in a variety of programming languages, including but not limited to JAVA and C#; and

• experience in development using a broad variety of integration techniques, patterns, tools and methodologies.

In line with the SARB’s commitment to diversifying its workforce, preference will be given to suitable candidates from designated groups. People with disabilities are welcome to apply.

The SARB offers remuneration and benefits commensurate with the level of the position and in line with the market. The level at which the successful applicant will be appointed will depend on his/her competence and experience.