Senior AWS Data Engineer

The role will be responsible for setting up the data warehouses
necessary to handle large volumes of data, create meaningful analyses, and
deliver recommendations to leadership. 

Core
Responsibilities

• Create and
  maintain optimal data pipeline architecture ETL/ ELT into structured data
  
• Assemble
  large, complex data sets that meet business requirements and create and
  maintain multi-dimensional modelling like Star Schema and Snowflake
  Schema, normalisation, de-normalization, joining of datasets.
  
• Expert level
  experience in creating a scalable data warehouse including Fact tables,
  Dimensional tables and ingest datasets into cloud based tools.
  
• Identify,
  design, and implement internal process improvements including automating
  manual processes, optimising data delivery and re-designing infrastructure
  for greater scalability.
  
• Collaborate
  with stakeholders to ensure seamless integration of data with internal
  data marts, enhancing advanced reporting
  
• Setup and
  maintain data ingestion, streaming, scheduling, and job monitoring
  automation using AWS services. Setup Lambda, code pipeline (CI/CD), Glue,
  S3, Redshift needs to be maintained for uninterrupted
  automation.
  
• Build
  analytics tools that utilize the data pipeline to provide actionable
  insight into customer acquisition, operational efficiency, and other key
  business performance metrics.
  
• Work with
  stakeholders to assist with data-related technical issues and support
  their data infrastructure needs.
  
• Utilize GitHub
  for version control, code collaboration, and repository management.
  Implement best practices for code reviews, branching strategies, and
  continuous integration.
  
• Create data
  tools for analytics and data scientist team members that assist them in
  building and optimising our product into an innovative industry leader
  
• Ensure data
  privacy and compliance with relevant regulations (e.g., GDPR) when
  handling customer data.
  
• Maintain data
  quality and consistency within the application, addressing data-related
  issues as they arise.
  

Requirements

• 4-8 years of
  relevant experience
  
• Advanced
  working SQL knowledge and experience working with relational databases,
  query authoring (SQL) as well as working familiarity with a variety of
  databases and Cloud Data warehouse like AWS Redshift
  
• Experience in
  creating scalable, efficient schema designs to support diverse business
  needs.
  
• Experience
  with database normalization, schema evolution, and maintaining data
  integrity
  
• Proactively
  share best practices, contributing to team knowledge and improving schema
  design transitions.
  
• Develop data
  models, create dimensions and facts, and establish views and procedures to
  enable automation programmability.
  
• Collaborate
  effectively with cross-functional teams to gather requirements,
  incorporate feedback, and align analytical work with business objectives
  
• Prior Data
  Modelling, OLAP cube modelling
  
• Data
  compression into PARQUET to improve processing and finetuning SQL
  programming skills.
  
• Experience
  building and optimizing “big data” data pipelines, architectures and data
  sets.
  
• Experience
  performing root cause analysis on internal and external data and processes
  to answer specific business questions and identify opportunities for
  improvement.
  
• Experience
  with manipulating, processing and extracting value from large disconnected
  unrelated datasets
  
• Strong
  analytic skills related to working with structured and unstructured
  datasets.
  
• Working
  knowledge of message queuing, stream processing, and highly scalable “big
  data” stores.
  
• Experience
  supporting and working with cross-functional teams and Global IT.
  
• Familiarity of
  working in an agile based working models.
  

Preferred
Qualifications/Expertise
 

• Experience
  with relational SQL and NoSQL databases, especially AWS Redshift.
  
• Experience
  with AWS cloud services Preferable: S3, EC2, Lambda, Glue, EMR, Code
  pipeline highly preferred. Experience with similar services on another
  platform would also be considered.
  

Education:

• Bachelor’s or
  master’s degree on Technology and Computer Science background