Data Engineer

Responsibilities
Design, develop, and implement data pipelines using Azure Data Factory, Power BI, or Databricks
Extract data from various sources, including databases, APIs, and external data providers
Transform data to meet the needs of our data analysts and data scientists
Load data into our data warehouse and data lake
Ensure data quality and integrity through data validation, cleansing, and error handling
Monitor and maintain data pipelines
Document data pipelines and processes
Collaborate with data analysts, data scientists, and other stakeholders to understand data needs and develop solutions
Qualifications 2+ years of experience as a Data Engineer or related role
Experience with cloud platforms like Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP) ( Preferred ). Experience with Azure Data Factory, Power BI, or Databricks ( Mandatory )
Experience with SQL and a scripting language like Python or Scala
Experience with data warehousing and data lake concepts
Experience with data quality tools and techniques
Strong problem-solving and analytical skills
Excellent communication and collaboration skills
Ability to work independently and as part of a team
Requirements

Responsibilities Design, develop, and implement data pipelines using Azure Data Factory, Power BI, or Databricks
Extract data from various sources, including databases, APIs, and external data providers
Transform data to meet the needs of our data analysts and data scientists
Load data into our data warehouse and data lake
Ensure data quality and integrity through data validation, cleansing, and error handling
Monitor and maintain data pipelines
Document data pipelines and processes
Collaborate with data analysts, data scientists, and other stakeholders to understand data needs and develop solutions
Qualifications 2+ years of experience as a Data Engineer or related role
Experience with cloud platforms like Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP) ( Preferred ). Experience with Azure Data Factory, Power BI, or Databricks ( Mandatory )
Experience with SQL and a scripting language like Python or Scala
Experience with data warehousing and data lake concepts
Experience with data quality tools and techniques
Strong problem-solving and analytical skills
Excellent communication and collaboration skills
Ability to work independently and as part of a team