Data Engineer

Job Description

We are seeking a highly skilled Data Engineer to design, develop, and support enterprise-scale data integration and data warehousing solutions across Teradata and Hadoop ecosystems. The successful candidate will be responsible for building scalable ETL/ELT pipelines, data ingestion frameworks, automation capabilities, and performance-optimized data processing solutions to support enterprise reporting, analytics, Master Data Management (MDM), and Change Data Capture (CDC) initiatives.

The ideal candidate will possess strong hands-on experience in Informatica PowerCenter, Teradata, Hadoop technologies, and enterprise data engineering best practices, with the ability to work closely with business and technology stakeholders to deliver high-quality data solutions.

Key Responsibilities

• Design, develop, and maintain enterprise ETL/ELT solutions using Informatica PowerCenter, Teradata SQL, Apache Spark, QueryGrid, and Trino.
• Build and support scalable data pipelines for ingestion, transformation, and integration of large-scale enterprise data.
• Develop and optimize Teradata-based Enterprise Data Warehouse (EDW) and Data Mart solutions.
• Perform performance tuning and optimization of complex ETL jobs, SQL queries, and data processing applications to improve efficiency and reduce resource consumption.
• Design and implement reusable ETL frameworks, automation utilities, and orchestration capabilities using shell scripting, BTEQ, and enterprise scheduling tools.
• Develop and enhance Change Data Capture (CDC) solutions for near real-time data ingestion and synchronization.
• Build configurable data ingestion frameworks leveraging Java and enterprise integration technologies.
• Support implementation and enhancement of Master Data Management (MDM) platforms, including data validation, approval workflows, and reference data management.
• Integrate data across multiple enterprise systems while ensuring data quality, consistency, and governance standards.
• Collaborate with business users, solution architects, application teams, and infrastructure teams to gather requirements and deliver scalable solutions.
• Troubleshoot production issues, perform root cause analysis, and implement preventive measures.
• Ensure adherence to enterprise data governance, security, and compliance requirements.
• Prepare and maintain technical documentation, operational procedures, and deployment guides.
• Participate in project planning, estimation, design reviews, and code reviews.

Requirements

Education

• Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.

Experience

• Minimum 5 years of experience in Data Engineering, Data Warehousing, or ETL Development.
• Proven experience delivering enterprise-scale data integration and analytics solutions.
• Experience working in large-scale data warehouse and big data environments.