From the course: Data Management with Apache NiFi

Unlock this course with a free trial

Join today to access over 24,400 courses taught by industry experts.

Configuring task concurrency

Configuring task concurrency - Apache NiFi Tutorial

From the course: Data Management with Apache NiFi

Start my 1-month free trial Buy for my team

Configuring task concurrency

“

- [Instructor] Now let's see how we can configure a processor to be executed using multiple concurrent tasks. Because we're going to be changing the configuration settings for PutDatabaseRecord, I've selected it and I'm going to stop this processor. Remember, a processor can be configured only when it's in the stop state. Double click to bring up its dialog and let's head over to the Scheduling tab. Notice we have concurrent tasks set to one. I've now set it to two so that there'll be two concurrent tasks that'll execute when we run this processor. Let's now restart the PutDatabaseRecord processor as well and I'll now add some new data to the datasets folder that can be processed by our data flow. Let's select these five files car_ad_06 to 10 and paste it into the datasets folder. Now let's head back to our NiFi data flow and watch these files be processed. Initially queued just before PutDatabaseRecord will be zero,…

Contents