From the course: Data Management with Apache NiFi

Unlock this course with a free trial

Join today to access over 24,400 courses taught by industry experts.

Reading from files and storing in a database

Reading from files and storing in a database - Apache NiFi Tutorial

From the course: Data Management with Apache NiFi

Reading from files and storing in a database

- [Instructor] Now that we have the laptops database and our S3 bucket set up, let's turn our attention to our NiFi flow. Now that you've had sufficient experience building up flows from scratch, I've actually set up the flow for you. We'll just walk through the different properties, so you know how each processor is configured. We won't walk through the mechanical details of actually connecting up and configuring every processor. The read laptops details processor is a get file operation that will read files from the local file system, files that match a pattern. Store Laptop Details In DB is a put database record processor, which will store records into our Postgres database. Once we've stored our laptop details in our database, we perform two filtering operations, Filter Ultrabook Laptops and Filter Notebook Laptops. These filtering operations are execute SQL processors which will run SQL queries to extract Ultrabooks…

Contents