From the course: Data Management with Apache NiFi

Unlock this course with a free trial

Join today to access over 24,400 courses taught by industry experts.

Modularize dataflows with process groups

Modularize dataflows with process groups - Apache NiFi Tutorial

From the course: Data Management with Apache NiFi

Modularize dataflows with process groups

- [Instructor] We've set up a fairly complex data flow here, and you must admit it's kind of hard for us to see everything that's going on. It would be much better if we had different processors grouped together. Well, that's possible using process groups. A process group in Apache NiFi is an organizational construct that allows you to group and manage processors, input/output ports, and other components as a single unit within a data flow. I'm going to set up a process group with three processes, ConvertAvroToJSON, ConvertRecord, and UpdateAttribute. So before I do that, I'm going to get rid of all of the connections that these processors have with other processors. So I'm going to delete each connection. We'll set up a process group, and then set up the connections afresh. So here, I've deleted all of the connections, and my three processors, ConvertAvroToJSON, ConvertRecord, and UpdateAttribute, have all been…

Contents