Sr. Big Data Engineer

Seasoned Data Professional

Seasoned data professional with demonstrated ability to approach data challenges holistically and practically, in line with the strategic needs of a digital bank. Proven track record in constructing robust Big Data pipelines capable of real-time processing, instrumental in delivering instant banking services and real-time analytics. Extensive development experience with Cloudera CDP, familiar with its various components and their application in a digital banking environment. Hands-on experience with Spark, Spark Streaming, and Spark optimizations, capable of managing large-scale, high-speed data processing tasks crucial in digital banking. Proficient with Hive, Impala Kudu, HBase, and Phoenix, experienced in managing substantial databases typical in the banking sector. Skilled in using orchestration tools like Oozie & Airflow, capable of managing complex workflows integral to automated banking processes. Experienced Kafka developer, adept at using Kafka Connect, Schema Registry, and Kafka Stream for handling high-volume, real-time messaging crucial for digital banking services. Proficient with Apache Nifi and Nifi Registry, experienced in managing complex data flows vital for real-time banking operations. Solid programming skills in Scala, Python, and Java, with a focus on developing and optimizing data-intensive applications for digital banking.

• Minimum 5 years experience in Big Data
• Experience in below technologies:
  • Kudu
  • Kafka
  • HBase
  • Cloudera
  • PySpark

This job has been sourced from an external job board.
More jobs on