Senior Data Engineer

Responsibilities:

• The Data Engineer(s) services shall provide services including, but not limited to, requirement gathering, strategizing, planning, implementing, maintaining, monitoring and reporting on aspects of the Data Engineering and Architecture Platforms and related processes. These responsibilities encompass:
• Data Domain business workflow interpretation, data requirement study, data exploration, creation of entity relationship diagram, data model creation, data extraction, transformation, and loading (“ETL”), pipeline creation and servicing data requests
• Data Platform Operations, setup, installation, access controls and pipeline monitoring and maintenance to validate quality data outputs post-data fusion to ensure safe use of data by safe users for the safe purposes.
• Data Platform upgrade, migration, apply related testing (unit testing, SIT, UAT) and implementation, through design, develop and implement robust processes, automation for secure and efficient data fusion, data exploitation and data sharing.
• Documentation from data dictionary, workflow processes, maintenance of reporting for Data Incident Concierge (DIC) and others
• Paperwork for Data Administration, such as Assets New staff / forms, Data Request Form, to concierge & service, procurement of Tools
• Collaborate with partners and cross-teams to benchmark best practices and drive continuous improvement in driving processes that enable data interpretability and searchability (e.g., data catalogues, data classification, data concierge services), develop, design, enhance and maintain tools and its contents such as that of Microsoft Purview

Requirements:

• Minimum 4 years of experience in hands-on data engineering, systems implementation, or equivalent roles, where data modelling will be a plus.
• Proficient in PySpark, SQL (Structured Query Language), and/or Python and adeptness with large
• Proficiency in Microsoft Azure, Power BI (Business Intelligence), Agile, or other Project Management Methodology certification
• Relevant work experience in data integration, analytics, system integration, working on data pipelines, including data extraction, transformation and load (ETL), basic exploratory data analytics (EDA), data cleaning, and/or feature engineering with a good understanding of information management practices including information lifecycle management, data modelling, master data management and carrying out business requirements gathering.

The following experience and knowledge would be deemed as advantageous:

• Gathering requirements for data warehouse or similar data systems
• Change Management, Risk Management and Incident Management
• Supporting relevant Government Projects

To apply,simply click the "Apply" button or send your updated profile to [email protected] 

EA Licence No.:18S9405 / EA Reg. No.:R1330864

Percept Solutions is expanding and actively seeking talented individuals. We encourage applicants to follow Percept Solutions on LinkedIn at https://www.linkedin.com/company/percept-solutions/to stay informed about new opportunities and events.