Data Engineer (Azure Data Platforms)

Summary

Responsibilities

• Architect and develop end-to-end data solutions utilizing the Azure ecosystem, including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
  
• Implement real-time data streaming and processing capabilities using Apache Airflow, Kafka, and Azure Functions.
  
• Manage and optimize data storage strategies across Cosmos DB and Blob Storage to ensure high availability and performance.
  
• Establish comprehensive data governance and lineage tracking frameworks using Azure Purview to maintain compliance and data quality.
  
• Collaborate with cross-functional teams to translate business requirements into technical data specifications and scalable architectures.
  
• Monitor data pipeline performance, troubleshoot issues, and implement continuous improvements to enhance system efficiency.
  

• Possess 3-6 years of hands-on professional experience in data engineering within the IT Services industry.
  
• Demonstrate proven proficiency with Azure data services, specifically Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
  
• Exhibit strong expertise in managing NoSQL databases (Cosmos DB) and object storage solutions (Blob Storage).
  
• Have practical experience implementing streaming data architectures using Apache Airflow and Kafka.
  
• Understand and apply data governance principles using tools like Azure Purview.
  
• Hold a competitive salary expectation aligned with the market rate of ₹10 LPA for the specified experience level.