Senior Cloud Data Engineer

BLUMIE is a leading data consultancy firm dedicated to delivering fastpaced data solutions to businesses across various industries. With specialized experts we are committed to empowering businesses through data science analytics and AI optimizing costs and maximizing revenue.

We are seeking Data Engineers with strong SQL expertise python development skills and ETL development. This role is instrumental in significant initiatives to transform all aspects of data management services for our clients and their internal software development efforts. The work leads to revised approaches to enterprise data warehousing business intelligence and data wrangling along with ELT/ETL development.

You will play a significant role in the implementation maintenance and continuous improvement of enterprise data platforms and work closely with business stakeholders software development and support teams as well as cloud DevOps. You will get a unique opportunity to work with cutting edge technologies and be part of data teams that help clients with endtoend data science programs.

Tasks

• Collaborate with engineers and business customers to understand data schemas and models in internal and source systems
• Design and develop data pipelines and wrangling procedures using Python and SQL
• Monitor data pipelines and data ingestion/wrangling jobs to ensure all procedures complete within their designated SLA
• Design and build a data pipeline monitoring tool for quick identification of data pipeline/ingestion/extraction failures
• Perform audit of data ingestion processes identifying gaps in standards and opportunities for optimization and refactoring
• Tune application and query performance using performance profiling tools and SQL
• Redesign and rebuild data pipelines with added monitoring and internal validation capabilities of data
• Support a big data platform through improvements and optimizations that minimize technical debt
• Use database skills to explore source system data querying and accessing schemas
• Build data expertise and own data quality for allocated areas of ownership

Requirements

• C1 English level
• Bachelors degree from a fouryear college or university in Computer Science Technology or related field
• 5 years of production experience as a Data Engineer ideally using the AWS stack (e.g. Redshift Lambda and Cloud Functions)
• 5 years of experience in using SQL Python and data warehousing in a business environment
• 5 years of experience in cloud environment distributed systems system automation and realtime platform.
• 5 years of experience in custom ETL design implementation and maintenance.
• 5 years of experience with data warehouse schema design and data modeling.
• Experience with identifying bottlenecks in SQL and tuning. Experience with Redshift is highly desirable.
• Production level experience programming in Python SQL and shell scripting
• Experience with AWS technologies (IAM S3 SQS SNS Cloud Trail)
• Experience with CI/CD tools (Github actions) or similar.
• Experience with orchestration tools (Airflow Dagster) or similar.
• Experience with building large scale data processes
• Experience with Kubernetes and Docker in a production environment
• Experience with APIs and SFTP/FTP servers
• Solid understanding of data design patterns and best practices.
• Familiarity with agile software development practices and drive to ship quickly.
• Experience leading change taking initiative and driving results
• Effective communication skills and strong problemsolving skills.
• Proven ability and desire to mentor others in a team environment
• Retail production experience (highly desired)
• Experience with Terraform and Terraform Cloud is highly desirable.

Benefits

Why BLUMIE

• Competitive (USD) salary package to attract and retain top talent in the industry.
• Growth and Development: Boundless opportunities for professional advancement.
• WorkLife Harmony: Enjoy the flexibility of a full remote work.
• Stability and Freedom: Benefit from an indefiniteterm contractor agreement.
• Equipment: Blumie provides you with working equipment
• Publication of articles: Blumie gives you the opportunity to grow in the professional field by giving you economic retribution for the publication of articles.

Dare to make a difference Step into a world where your work not only matters but leads the way. Apply now and redefine whats possible.

*At BLUMIE diversity and inclusivity fuel our innovation. Were proud to be an equal opportunity employer where every application is evaluated purely on merit. Regardless of race color religion gender sexual orientation gender identity national origin disability or veteran status your potential with us is limitless.