From the course: Data Management with Apache NiFi
Unlock this course with a free trial
Join today to access over 24,400 courses taught by industry experts.
Configure processors to execute SQL queries - Apache NiFi Tutorial
From the course: Data Management with Apache NiFi
Configure processors to execute SQL queries
- [Instructor] In this demo, we'll continue building on the data flow that we had earlier. We'll write to the database table, then execute some SQL queries on that table group and aggregate our data and write the grouped aggregated data out to the local file system once again. Now before we get started, I'm going to call truncate cars so that we have no records in our cars table. Select count(*) from cars should return nothing. Our database table is now clean. We can get started with our data flow. I'll pick up where we left off in the previous demo. Minimize the Navigate and Operate menus so that we have more room for our data flow. Notice I have GetFile, then ReplaceText and PutDatabaseRecord. They are configured as they were in the previous demo. We'll now add new processes to our data flow. But first I want to add a retry loop to put database record. Simply pull on that little arrow and this will bring up a Create…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
Set up a PostgreSQL table3m 11s
-
(Locked)
Add GetFile and PutDatabase processors3m 23s
-
(Locked)
Configuring the CSVReader controller service3m 46s
-
(Locked)
Configuring the DBConnectionPool controller service4m 26s
-
(Locked)
Running and encountering dataflow errors2m 47s
-
(Locked)
Configuring the ReplaceText processor2m 58s
-
(Locked)
Running a dataflow to insert data into PostgreSQL2m 35s
-
(Locked)
Configuring the Run schedule3m 14s
-
(Locked)
Configuring task concurrency2m 58s
-
(Locked)
Configure processors to execute SQL queries4m 25s
-
-
-
-
-