Data Engineer

Role Overview

We are seeking a highly skilled Cloud Data Engineer to design, develop, and maintain scalable and efficient data solutions on cloud platforms. The ideal candidate will have strong expertise in the Azure data ecosystem, including Azure Data Factory, Azure Databricks, and Power BI, along with hands -on experience in handling large -scale data processing.

This role involves building robust data pipelines, implementing modern data architectures such as Lakehouse and Data Mesh, and ensuring high -quality data delivery for analytics and reporting.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and workflows using Azure Data Factory (ADF) and Azure Databricks.
  
• Build and optimize data processing solutions for large datasets using Python, PySpark, and SAS.
  
• Develop and maintain Power BI dashboards and reports to deliver actionable insights to stakeholders.
  
• Implement and manage data solutions using Azure Data Lake Storage (ADLS) and Lakehouse architecture.
  
• Apply data modeling techniques to ensure data quality, consistency, and performance.
  
• Integrate multiple data sources and ensure data integrity through validation and testing.
  
• Develop and execute unit test cases to ensure reliability and accuracy of data pipelines.
  
• Troubleshoot and resolve data -related issues, ensuring smooth data operations.
  
• Collaborate with cross -functional teams including business analysts, data scientists, and IT teams to gather requirements and deliver scalable solutions.
  
• Contribute to the implementation of Data Mesh architecture and modern data platform strategies.
  
• Ensure adherence to best practices in cloud data engineering, governance, and security standards.
  
• Work closely with cloud infrastructure and architecture teams to align with organizational guidelines.
  

Required Skills & Expertise

• Strong experience in the Azure Data Stack
  
• Hands -on expertise with:
  • Azure Data Factory (ADF)
    
  • Azure Databricks
    
  • Azure Data Lake Storage (ADLS)
    
  • Power BI
    
• Proficiency in Python, PySpark, and SAS
  
• Solid understanding of:
  • Medallion Architecture
    
  • Lakehouse Architecture
    
  • Data Mesh concepts
    
• Experience in data modeling, ETL/ELT design, and data integration
  
• Knowledge of data governance, testing, and validation frameworks
  
• Strong problem -solving and analytical skills