Data Engineer (Hybrid)

Job summary: We are seeking a highly skilled Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining the data infrastructure that supports our data analytics and machine learning initiatives. This includes developing and managing data pipelines, building and optimizing data warehouses and data lakes, and ensuring the quality and security of data. Job description:

• Design, build, and maintain scalable data pipelines using Databricks and Azure Data Factory.
• Develop and manage data warehouses and data lakes to support data analytics and machine learning initiatives.
• Ensure the quality, accuracy, and security of data.
• Collaborate with data scientists, analysts, and other stakeholders to support their data needs.
• Continuously monitor, test, and improve the performance and reliability of our data infrastructure.

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Minimum of 3-4 years of experience as Data Engineer or related role.
• Strong experience with Databricks and Azure Data Factory.
• Experience with data warehousing, data modeling, and data architecture.
• Proficiency in SQL, Python, Scala and experience with big data technologies such as Hadoop, Spark, and Hive.