Data Engineer (Hybrid)

We are seeking a skilled Data Engineer with expertise in Airflow and AWS to join our data engineering team. The ideal candidate will have experience designing and implementing data pipelines using Apache Airflow and AWS services, as well as a strong background in data science and analytics. This role involves working closely with data engineers, analysts, and business stakeholders to deliver high-quality data solutions that drive business insights and decision-making.

Responsibilities

●  Design, develop, and maintain data pipelines using Apache Airflow to automate data processing tasks.

●  Work with AWS services such as S3, Redshift, RDS, Lambda, and Glue to build and maintain scalable data solutions.

●  Develop and maintain ETL processes, data transformations, and data modeling.

●  Collaborate with data engineers, analysts, and other stakeholders to define data requirements and ensure data quality and availability.

●  Conduct exploratory data analysis to identify patterns and trends in data, and communicate findings to stakeholders.

●  Develop data-driven models and algorithms to support business objectives and decision-making.

●  Monitor data pipelines for performance and reliability, and troubleshoot issues as needed.

●  Stay up-to-date with industry best practices and emerging technologies in data science and cloud computing.

●  Contribute to the development of data governance and data management best practices.

Qualifications

●  Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.

●  Strong experience with Apache Airflow for orchestration and automation of data pipelines.

●  Proficiency in AWS services such as S3, Redshift, RDS, Lambda, and Glue.

●  Experience with Python programming and libraries such as Pandas, NumPy, and scikit-learn.

●  Familiarity with SQL and data manipulation languages.

●  Strong analytical and problem-solving skills.

●  Excellent communication and collaboration skills.

●  Experience with data visualization tools such as Tableau, Power BI, or similar is a plus.

●  Knowledge of machine learning techniques and algorithms is a plus.

Benefits

●  Monthly learning & wellness stipend

●  Internal training

●  Unlimited subscriptions to streaming services & movie tickets