Lead Data Engineer

Job Title: Lead Data Engineer – GCP
Experience: 7-12 Years
Location: Chennai/Pune/Bangalore/Coimbatore

About the Company:
Our client is a fast-growing technology-driven organization focused on building scalable, cloud-based data platforms and modern analytics solutions. The company specializes in leveraging cutting-edge cloud technologies and data engineering practices to enable data-driven decision-making. With a strong focus on innovation, data quality, and governance, the organization fosters a collaborative and high-performance engineering culture.

Role Overview:
We are looking for a highly skilled Lead Data Engineer with strong expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, developing, and optimizing scalable cloud-based data processing pipelines for enterprise-grade applications.

Key Responsibilities:

• Design and develop scalable ETL/ELT pipelines using GCP services.
  

• Build and maintain real-time and batch data processing pipelines using Dataflow and Apache Beam.
  

• Develop robust backend processing solutions using Java.
  

• Work extensively with BigQuery for data warehousing, analytics, and performance optimization.
  

• Integrate data from multiple sources including APIs, databases, and streaming platforms.
  

• Optimize pipeline performance, cost, scalability, and reliability on GCP.
  

• Collaborate with cross-functional teams including Architects, Analysts, DevOps, and Business stakeholders.
  

• Ensure data quality, governance, monitoring, and security best practices.
  

• Troubleshoot production issues and provide long-term scalable solutions.
  

Required Skills:

• Strong hands-on experience with GCP services.
  

• Expertise in Google Dataflow / Apache Beam.
  

• Strong programming skills in Java.
  

• Hands-on experience with BigQuery.
  

• Experience in building batch and streaming data pipelines.
  

• Good knowledge of SQL and data modeling concepts.
  

• Experience with CI/CD, Git, and Agile methodologies.
  

• Strong problem-solving and debugging skills.
  

Eligibility / Qualifications:

• Education: Bachelor’s degree in IT / Computer Science / Engineering / related field