Job Title: Data Engineer with Data Operations

Experience: 5+ Years Employment Type: Contract Duration: 6 Months (Extendable) Location: Kolkata

Key Responsibilities:

• Design, develop, and maintain robust data pipelines to support data integration from Oracle Flexcube and other data sources into the Cloudera Data Platform.
• Utilize Hadoop for efficient data storage and Hive+Impala for data querying and processing.
• Ensure the reliability, scalability, and performance of data operations.
• Implement best practices for data management, including data quality, data governance, and data security.
• Monitor and troubleshoot data pipelines to ensure smooth data flow and timely resolution of issues.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
• Automate data workflows and processes to enhance operational efficiency.
• Develop and maintain documentation related to data engineering and operations processes.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 5+ Years of experience in data engineering and data operations, preferably in the banking sector.
• Strong knowledge of Oracle Flexcube, APIs, JDBC/ODBC connection, SQL, Python, Spark (PySpark), Cloudera Data Platform, Hadoop, Hive, and Impala.
• Cloud knowledge is a plus.
• Proven experience in designing and managing data pipelines.
• Excellent analytical and problem-solving skills.