Sr Technology Engineer - Hadoop

About the Role:

We are hiring a Senior Technology Engineer with strong expertise in Hadoop-based Big Data ecosystems, automation, and DevOps tools. The role is pivotal in designing and implementing scalable, secure, and high-availability infrastructure, driving banking client’s data strategy by transforming data management and analytics platforms.

Key Responsibilities:

• Hadoop Ecosystem Implementation:
  Architect and manage big data solutions using Hadoop, Spark, Kafka, Hive, and related components.
• Infrastructure as Code & Automation:
  Build and maintain IaC using Terraform or Ansible. Ensure 100% automated deployment pipelines.
• DevOps and CI/CD:
  Design CI/CD pipelines using Jenkins, GitOps, and integrate with containerized environments (Docker/Kubernetes/OpenShift).
• Security & Governance:
  Implement enterprise-grade security mechanisms (e.g., Kerberos, LDAP, TLS) and align with Data Governance best practices.
• Monitoring and Optimization:
  Set up observability tools (Prometheus, Grafana, ELK) and performance optimization processes.
• Collaboration:
  Work closely with cross-functional teams including architects, developers, and business analysts to translate requirements into reliable solutions.

Required Qualifications:

• Education:
  Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• Experience:
  8+ years in IT, with at least 3+ years in Big Data platforms and architecture.
  Proven experience in the banking or financial services domain.

Technical Skills:

• Deep expertise in the Cloudera Hadoop (CDP) stack, including versions 7.1.7 to 7.1.9.
• Experience with Kerberos, LDAP/AD integration, and TLS security.
• Hands-on with CI/CD, Jenkins, Git, Linux CLI, Bash/Python scripting.
• Strong understanding of Distributed Data Architecture, Data Quality, Metadata Management, and Data Governance.
• Experience with BI tools like Power BI and Tableau is a plus.

Soft Skills:

• Excellent problem-solving, communication, and stakeholder management.
• Ability to work in fast-paced, matrixed environments.
• Self-driven, organized, and adaptable with mentoring capabilities.

Preferred Certifications (Nice to Have):

• Hadoop/Big Data Certifications
• Kubernetes/OpenShift/Cloud certifications
• DevOps tools certifications