Senior Kafka Platform Admin

Jobs for Humanity is collaborating with FIS Global to build an inclusive and just employment ecosystem. We support individuals coming from all walks of life. Company Name: FIS Global

Job Description

Position Type :

Full time

Type Of Hire :

Experienced (relevant combo of work and education)

Education Desired :

Bachelor of Computer Engineering

Are you ready to unleash your full potential? We’re looking for people who are passionate about payments to chart Worldpay’s path to being the largest and most-loved payments company in the world.

About the team:

Worldpay Cloud Data Platform team provides WorldPay big Data capabilities including large scale data processing, analytics, fraud platforms, machine learning engineering, stream processing and data insights. Worldpay Cloud Data Platform team help maintain and advance cloud data platforms and services to build data products powering our business services and customers.

What you will be doing

We are seeking an experienced Kafka Administrator to join our team. The Kafka Administrator will design, build, test, and deploy high-quality messaging and streaming solutions consistent with project objectives, technology architecture standards, and departmental best practices. The role involves administering enterprise-wide messaging architecture and providing daily management of the Kafka ecosystem.

• Cluster Management:
  • Manage large-scale, multi-node Kafka cluster environments on AWS and on-premises Linux Redhat platforms.
  • Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning, and ongoing monitoring.
• Operational Maintenance:
  • Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.
  • Create key performance metrics to measure the utilization, performance, and overall health of the cluster.
• Capacity Planning:
  • Plan and implement new/upgraded hardware and software releases and storage infrastructure.
  • Research and recommend innovative solutions and automate key administration tasks.
• Collaboration and Guidance:
  • Closely collaborate with product managers and lead engineers.
  • Provide guidance in the creation and modification of standards and procedures.
• Monitoring and Alerts:
  • Create topics, set up redundancy clusters, deploy monitoring tools, and configure alerts.
  • Proactively monitor the Kafka Cluster and supporting hardware to ensure system health and maximum availability.
• Technical Expertise:
  • Provide technical expertise and guidance to production support.
  • Design, build, assemble, and configure application or technical architecture components using business requirements.

What you bring:

• 5+ years of solid Kafka Admin experience managing critical 24/7 applications.
• Hands-on experience with Kafka clusters hosted on AWS and on-prem Linux RedHat.
• Experience in building Kafka pipelines using Terraform, Ansible, CloudFormation templates, shell scripts, etc.
• Implementation of security & authorization (permission-based) on Kafka clusters.
• Setting standards to automate deployments using Kubernetes, Docker, Chef, or Jenkins.
• Experience with open source and Confluent Kafka, Zookeeper, Kafka Connect, Schema Registry, KSQL, Rest Proxy, and Kafka Control Center.
• Experience with Kafka Mirror Maker or Confluent Replicator.
• High availability cluster setup, maintenance, and ongoing 24/7 support.
• Establish best practice standards for configuring Source and Sink connectors.
• Experience in administrating Kafka platforms from scratch, including backup, mirroring, broker sizing, topic sizing, performance monitoring, security, and ACL management.
• Knowledge of Kafka API, security, performance, and disaster recovery best practices.
• Ability to synthesize complex data into meaningful conclusions and present recommendations.
• Excellent communication and interpersonal skills.

Preferred:

• Experience in setting up Prometheus/Grafana or ELK monitoring tools.
• Linux (RHEL)/Unix administration experience.
• Experience with AWS Cloud.

Soft Skills:

• Ability to concentrate on a wide range of loosely defined complex situations requiring creativity and originality.
• Ability to maintain a positive attitude while working under high demands and short deadlines

Added bonus if you have:

Kafka Certification

What we offer you:

• A competitive salary and benefits
• A variety of career development tools, resources and opportunities
• The chance to work on some of the most challenging, relevant issues in the payment industry
• Time to support charities and give back in your community

Privacy Statement

FIS is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how FIS protects personal information online, please see the Online Privacy Notice.

Sourcing Model

Recruitment at FIS works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. FIS does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.

#pridepass