Data Engineer

Main Tasks

• Working cross-functionally with business managers/product managers/engineers and data scientists to gather requirements and to understand their business processes


• Design, develop, deploy, manage scalable cloud infrastructures that solve business problems


• Designing, implementing, and managing optimal data analytics pipelines from end-to-end


• Making strategic data architecture recommendations


• Implementing data science frameworks to enable organization-wide experiments, enable data science research and development and enable deployment of production solutions


• Implementing systems that enable delivery of insights to business units and customers


• Apply dev-ops processes to deliver and maintain production level systems


• Apply quality processes to ensure the requirements are met


• Implement and manage security in accordance with industry standards


• Document all aspects of design, implement, test and release

Job Requirements (Qualifications, Skills, Experience, Competencies)

As a successful applicant, you would have a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field with the ability to manage stakeholders and communicate well. You will have strong experience in cloud technologies (AWS/Azure or similar) with at least 5 years of experience in a Data Engineer role.

• A history of working with large scale reliable data systems


• Proficient with cloud technologies and application of native services


• Experience with big data tools and delivery of big data solutions


• Experience in working with different types of data stores including SQL, NoSQL, warehouses, lakes, etc


• Experience working in Hadoop ecosystem and Spark is a plus


• Experience with data ingestion and data integration tools and frameworks, data pipeline and workflow management, common data science tools such as R, python, Big data technologies, Tableau


• Proven ability to deliver high profile activities to tight timescales


• Proven ability to apply analytical and creative thought


• Ability and desire to learn and pick up new tools and technologies for problem solving, enhancing analysis results and accuracy, and optimizing workflow efficiency


• Independent and possess creative problem solving skills to address business problems from different perspectives


• Ability to distil and communicate results to all organisational levels


• Practice a lean agile scrum process to continuously deliver value to customers


• Proven success in contributing to a team-oriented environment


• Ability to interact with global teams and manage the related cultural challenges


• Be able to interact with development teams to determine project requirements


• Readiness to travel globally.