Apache NiFi
On this page
Apache open-source visual dataflow for ETL/ELT.
Definition
NiFi uses FlowFiles with attributes and content, Processors (GetFile, PutKafka, EvaluateJsonPath), Connections (back-pressure queue), Process Groups. Cluster mode via Zookeeper. Full provenance tracking for audit. MiNiFi (edge agent) for IoT.
Origin
Created by NSA (NiagaraFiles) in 2006 ; open-sourced Apache in 2014.
Example in context
A NiFi dataflow ingests 1000 EDI files/min via GetSFTP then dispatches to Kafka topics.
Related terms
- Apache Camel — code-first alternative.