Data Integrations Engineer (Nifi) - South Africa

Data Integrations Engineer (NiFi)

We are seeking a Data Integration Engineer with deep experience in Apache NiFi, Kafka, and enterprise systems like SAP, to design and implement secure, scalable, and real-time data pipelines for a high-profile client implementation project. The ideal candidate will have expertise in managing structured and semi-structured data, integrating legacy and modern systems, and automating data flows across cloud and on-prem environments.

Key Responsibilities:

• Design, develop, and maintain NiFi data pipelines for ingesting and transforming data from various sources (including SAP, APIs, flat files, DBs).


• Integrate messaging systems like Kafka and RabbitMQ into the pipeline for event streaming and system decoupling.


• Work closely with Business Analysts and BPEs to translate client requirements into technical data flows.


• Implement and manage connectors for SAP, REST APIs, and file-based batch processes.


• Ensure data lineage, auditability, and performance tuning of NiFi flows.


• Deploy and monitor data flows in distributed environments using Zookeeper, Kafka, and ElasticSearch for logging and observability.
  
  

Required Skills:

• 3–5+ years of experience in data integration/engineering roles.


• Strong expertise with Apache NiFi (flow design, templates, version control, custom processors).


• Proficient in Kafka, RabbitMQ, and event-driven architectures.


• Experience integrating with SAP (BAPIs, IDocs, OData) and legacy systems.


• Scripting and transformation in Python, Groovy, or Java.
  Familiarity with distributed systems (Zookeeper, ElasticSearch, etc.).


• Experience with CI/CD for NiFi or container-based deployments (Docker, Kubernetes).
  
  

Nice to Have:

• Knowledge of security practices (TLS, role-based access in NiFi).


• Hands-on with monitoring tools (Prometheus, Grafana).


• Familiarity with cloud platforms (AWS/GCP/Azure) for data storage or processing.

Other Requirements:

• Eligibility for Top-Level Security Clearance:
  
  
  
  • Candidates must be eligible to obtain and maintain security clearance at the highest level, in accordance with applicable national security regulations.
  
  
  
  


• On-Site Work Requirement:
  
  
  
  • This role requires full-time, on-site presence at the client’s premises located in Pretoria. Remote or hybrid work arrangements are not applicable.