Question

What is the difference between Oozie and Nifi

Answer 1

Hey,

Nifi is basically a data ingestion tool. It can collect data from various platforms. These Data can put to HDFS and initiate processing with Hive, MapReduce, spark, etc.

Oozie is a data pipeline management and scheduler. It can group different activities like (spark, MapReduce, Hive) and process them in a single pipeline.

The main difference between both of them is 'Oozie' resources are fully managed by Yarn, whereas 'Nifi' is fully self-managed tool with pseudo-distributed mode.

Answer 2

The main difference between Oozie and Nifi is that Oozie is used for workflow scheduling to manage Hadoop jobs whereas Nifi is used to automate the flow of data between software systems.

Oozie runs a service in the cluster. The clients submit workflow definitions to Oozie and Oozie schedules these to manage Hadoop jobs.

Nifi provides real-time control that makes movement of data between systems easy.