Senior Data Engineer

· Identifying and extracting data from various sources (such as databases, APIs, logs, files, and external systems).

· Ensuring data quality during extraction and handling any anomalies.

· Transforming raw data into a structured format suitable for analysis and reporting.

· Cleaning, aggregating, and enriching data using ETL tools and techniques.

· Implementing business rules and data validation logic.

· Loading processed data into data warehouses, data lakes, or other storage systems.

· Designing and maintaining ETL pipelines to move data efficiently.

· Collaborating with database administrators to optimize data loading processes.

· Designing, developing, and maintaining ETL workflows and pipelines.

· Writing efficient ETL code (Informatica PowerCenter & Informatica BDM) to automate data movement.

· Ensuring scalability, reliability, and performance of ETL processes.

· Profiling and tuning ETL processes for optimal performance. · Identifying bottlenecks and addressing them to improve data processing speed.

· Monitoring ETL jobs, identifying failures, and resolving issues promptly.

· Implementing error handling and logging mechanisms.

· Communicating effectively with cross-functional teams to understand data needs and ensure data consistency and accuracy.