Senior Data Engineer

Job Title: Senior Data Engineer

Location: Remote
Experience: 7 - 10 Years

Only CV's which are as per JD will be shortlisted

Role Purpose

We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain scalable data pipelines and modern data platforms leveraging the Microsoft Fabric and Azure ecosystem. This role is critical in enabling data-driven decision-making by building efficient, reliable, and high-performance data solutions that support analytics, reporting, and advanced data use cases across the organization.

Key Responsibilities

Data Engineering & Development

• Design, build, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and Microsoft Fabric
• Develop and optimize data workflows using PySpark and SQL
• Implement and manage Lakehouse architecture using the Medallion (Bronze, Silver, Gold) layers
• Work with Azure Data Lake Storage (ADLS) and Delta Lake for scalable data storage and processing
• Integrate data from multiple sources while ensuring data quality, consistency, and reliability

Collaboration & Enablement

• Partner with BI developers and analysts to enable data models and reporting solutions
• Collaborate with cross-functional stakeholders to translate business requirements into technical solutions

Performance & Reliability

• Monitor, troubleshoot, and optimize data pipelines and system performance
• Ensure high availability and scalability of data platforms

Governance & Compliance

• Implement and enforce data governance, security, and compliance best practices
• Ensure proper data lineage, cataloging, and documentation

Additional Responsibilities (Senior Level)

• Lead the design and architecture of scalable data platforms and solutions
• Define and enforce data engineering standards, frameworks, and best practices
• Mentor junior data engineers and conduct code reviews to ensure quality and performance
• Optimize large-scale data processing and improve system efficiency and cost optimization
• Drive adoption of Microsoft Fabric and modern data engineering practices across teams

Required Skills & Qualifications

• 5+ years of experience in Data Engineering
• Strong hands-on experience with:
  • Azure Data Factory (ADF)
  • Microsoft Fabric
  • PySpark and SQL
  • Azure Data Lake Storage (ADLS)
  • Delta Lake
• Solid understanding of data modeling, ETL/ELT concepts, and Lakehouse architecture
• Experience with Medallion architecture (Bronze, Silver, Gold layers)
• Strong problem-solving and performance optimization skills
• Experience working in cloud-based data platforms (Azure preferred)

Preferred Qualifications

• Experience with Power BI or other BI tools
• Familiarity with data governance and security frameworks
• Exposure to CI/CD pipelines for data engineering workflows
• Experience working in Agile/Scrum environments