Azure Data Engineer

Job Title: Azure Data Engineer

Experience: 5+ Years

Job Description:

We are looking for a skilled Azure Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have strong hands-on experience with Azure Data Factory, Databricks, PySpark, Python, and Power BI, and will work closely with business and analytics teams to deliver reliable, high-performance data solutions.

Key Responsibilities:

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF).

• Build and optimize ETL/ELT workflows using Azure Databricks and PySpark.

• Develop data processing logic and transformations using Python.

• Ensure data quality, performance, scalability, and reliability of data solutions.

• Collaborate with stakeholders to understand business requirements and translate them into technical solutions.

• Support data modeling and prepare curated datasets for reporting and analytics.

• Create and optimize Power BI datasets and reports for business insights.

• Monitor, troubleshoot, and optimize data pipelines in production environments.

Required Skills & Qualifications:

• 5+ years of experience as a Data Engineer.

• Strong hands-on experience with Azure Data Factory (ADF).

• Expertise in Azure Databricks, PySpark, and Python.

• Experience building scalable data pipelines and processing large datasets.

• Strong SQL and data modeling skills.

• Hands-on experience with Power BI (datasets, reports, performance optimization).

• Good understanding of cloud data architecture and best practices.

Preferred Qualifications:

• Experience with Azure data services such as Azure Data Lake, Synapse Analytics.

• Understanding of data governance, security, and access controls.

• Experience working in Agile/Scrum environments.

• Strong communication and problem-solving skills.

Nice to Have:

• Experience in regulated industries (Finance, Healthcare, etc.).

• Exposure to CI/CD pipelines for data engineering workloads.