EY-GDS Consulting-AI And DATA-Databricks-Senior

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. 

Job Description – Senior Data Engineer

Job Summary

We are seeking a Senior Data Engineer to lead the design and delivery of enterprise-scale data solutions for a leading Insurance client. This role focuses on building robust, scalable data platforms using Azure and Databricks to support advanced analytics, regulatory reporting, and business insights. You will play a key role in architecting modern data ecosystems and guiding teams through data transformation initiatives.

Key Responsibilities

• Design and implement scalable, high-performance data pipelines using Azure and Databricks


• Lead data engineering efforts across ingestion, transformation, and data serving layers


• Collaborate with architects, business stakeholders, and cross-functional teams to define data strategies


• Ensure data quality, governance, security, and compliance with insurance industry regulations


• Drive modernization of legacy platforms (e.g., DB2, Datastage) to cloud-based architectures


• Optimize ETL/ELT processes for performance, scalability, and cost efficiency


• Mentor junior engineers and enforce best practices in coding, testing, and deployment


• Integrate enterprise and third-party systems using APIs and tools like Mulesoft

Required Skills

• Strong hands-on experience with Azure services (ADF, ADLS, Synapse) and Databricks


• Expertise in Python, SQL, and Apache Spark for large-scale data processing


• Deep understanding of data architecture, data warehousing, and lakehouse concepts


• Experience in Insurance or BFSI domain with enterprise data environments


• Knowledge of CI/CD pipelines, DevOps practices, and version control systems


• Strong problem-solving, analytical, and decision-making skills


• Proven ability to lead technical initiatives and mentor team members


• Excellent communication and stakeholder management skills

Preferred Qualifications

• Experience with Mulesoft, Datastage, and DB2 systems


• Understanding of insurance data models, claims, underwriting, and regulatory reporting


• Microsoft Certified: Azure Data Engineer Associate (DP-203)


• Databricks Certified Data Engineer (Associate or Professional)


• Exposure to data governance frameworks and tools

Experience & Education

• 5–10 years of experience in Data Engineering or related roles


• Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field

Work Location

• Bangalore or Kochi

EY | Building a better working world 

 

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  

 

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  

 

Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.