Data Engineer

Company : Verifitech

Job Type : Full Time

Chennai, India

Job Description - Data Engineer

Job title : Data Engineer

Experience: 6+ years

Location: Chennai

Shift: US Eastern Time ( 5:00 PM – 2:00 AM )

Requirements

We are seeking a hands-on Data Engineer to develop, optimize, and maintain automated

data pipelines supporting data governance and analytics initiatives. This role will focus on

building production-ready workflows for ingestion, transformation, quality checks, lineage

capture, access auditing, cost usage analysis, retention tracking, and metadata integration,

primarily using Azure Databricks, Azure Data Lake, and Microsoft Purview.

Experience: 6+ years in data engineering, with strong Azure and Databricks experience

Pipeline Development – Design, build, and deploy robust ETL/ELT pipelines in Databricks

(PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational

metadata from multiple sources landed in Databricks.

Granular Data Quality Capture – Implement profiling logic to capture issue-level metadata

(source table, column, timestamp, severity, rule type) to support drill-down from dashboards

into specific records and enable targeted remediation.

Governance Metrics Automation – Develop data pipelines to generate metrics for

dashboards covering data quality, lineage, job monitoring, access & permissions, query cost,

usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and

governance KPIs.

Microsoft Purview Integration – Automate asset onboarding, metadata enrichment,

classification tagging, and lineage extraction for integration into governance reporting.

Data Retention & Policy Enforcement – Implement logic for retention tracking and policy

compliance monitoring (masking, RLS, exceptions).

Job & Query Monitoring – Build pipelines to track job performance, SLA adherence, and

query costs for cost and performance optimization.

Metadata Storage & Optimization – Maintain curated Delta tables for governance metrics,

structured for efficient dashboard consumption.

Testing & Troubleshooting – Monitor pipeline execution, optimize performance, and resolve

issues quickly.

Collaboration – Work closely with the lead engineer, QA, and reporting teams to validate

metrics and resolve data quality issues.

Security & Compliance – Ensure all pipelines meet organizational governance, privacy, and

security standards.

Original job Data Engineer posted on GrabJobs ©. To flag any issues with this job please use the Report Job button on GrabJobs.

Share Job

Get your Resume Reviewed for Free

Similar Data Engineer Jobs in India

Get your Resume Reviewed for Free

Email address

Why are you reporting this job?

I think it’s a discriminatory or offensive

I think it’s fraudulent or a scam

I think it’s trying to sell something unrelated to the job / it’s asking for money

I think it contains incorrect or broken information

Other

All Job Ads are subject to GrabJobs’s Terms of Service. We allow users to flag postings that may be in violation of those terms. Job Ads may also be flagged by GrabJobs moderation team. However, no moderation system is perfect, and flagging a posting does not ensure that it will be removed.

Setup your job alert:

Frequency

By activating job alerts, I agree to GrabJobs Terms & Privacy Policy. I can unsubscribe to job alerts anytime. Skip

Data Engineer

Job Description - Data Engineer

Requirements

Similar Data Engineer Jobs in India

Mobile Apps