IN-Senior Associate_Azure & Databricks Expert_Data and Analytics_Advisory_Hyderabad

About the Role: 

We are seeking a Senior Data Governance Engineer with strong expertise in the Azure ecosystem and Databricks platform to lead the design and implementation of data governance frameworks and solutions. The successful candidate will combine hands-on technical skills in PySpark, Python, and SQL with deep domain knowledge of data governance tools such as Azure Purview and Databricks Unity Catalog. Exposure to Databricks Genie for orchestration will be an added advantage. 

You will play a critical role in ensuring data quality, security, compliance, and accessibility across the organization’s data assets by collaborating closely with data engineering, security, compliance, and business teams. 

Responsibilities: 

• Develop, implement, and maintain enterprise-wide data governance policies, procedures, and standards within the Azure ecosystem. 

• Leverage Azure Purview to manage data catalogs, lineage, classification, and metadata across multiple data sources. 

• Design and implement data access controls, data stewardship models, and compliance monitoring using Databricks Unity Catalog. 

• Build and maintain data quality and validation frameworks using PySpark, Python, and SQL within Azure Databricks environments. 

• Collaborate with engineering teams to embed governance standards into data pipelines and workflows. 

• Monitor adherence to data governance policies and regulatory compliance (e.g., GDPR, HIPAA) leveraging Azure and Databricks tools. 

• Utilize Databricks Genie or similar orchestration tools for automated workflow scheduling and job monitoring with governance checks. 

• Develop dashboards, reports, and alerts to track key data governance metrics and incidents. 

• Conduct training and awareness sessions to enhance data governance literacy across the organization. 

• Work across cross-functional teams including legal, security, risk, and business units to align governance strategies. 

• Stay current with emerging trends and best practices in data governance and cloud data platforms. 

Required Skills & Qualifications: 

• Bachelor’s or Master’s degree in Computer Science, Data Science, Information Systems, or a related discipline. 

• 5+ years of experience in data governance, data management, or data engineering roles within Azure-based environments. 

• Strong hands-on experience with Azure Purview for data cataloging, metadata management, and lineage tracking. 

• Proficiency in Databricks Unity Catalog to enforce fine-grained access control, data classification, and policy enforcement. 

• Expertise in developing data workflows and governance automation using PySpark, Python, and SQL on Azure Databricks. 

• Solid understanding of data governance principles, data privacy regulations, and compliance frameworks. 

• Some exposure to Databricks Genie or similar orchestration/scheduling tools. 

• Experience collaborating with data stewards, data owners, security teams, and compliance officers. 

• Strong analytical, documentation, and communication skills. 

Preferred Qualifications: 

• Azure certifications such as Azure Data Engineer Associate or Azure Security Engineer. 

• Familiarity with Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics. 

• Knowledge of DevOps and CI/CD pipelines in data governance automation. 

• Awareness or experience with LangGraph for integrating language models with data governance and knowledge graph processes is a plus. 

What We Offer: 

• Competitive salary and comprehensive benefits. 

• Opportunity to lead critical data governance initiatives on cloud platforms. 

• Collaborative and innovative work environment. 

• Opportunities for professional growth and learning.