From the course: Data Management with Apache NiFi
Unlock this course with a free trial
Join today to access over 24,400 courses taught by industry experts.
Reading from files and storing in a database - Apache NiFi Tutorial
From the course: Data Management with Apache NiFi
Reading from files and storing in a database
- [Instructor] Now that we have the laptops database and our S3 bucket set up, let's turn our attention to our NiFi flow. Now that you've had sufficient experience building up flows from scratch, I've actually set up the flow for you. We'll just walk through the different properties, so you know how each processor is configured. We won't walk through the mechanical details of actually connecting up and configuring every processor. The read laptops details processor is a get file operation that will read files from the local file system, files that match a pattern. Store Laptop Details In DB is a put database record processor, which will store records into our Postgres database. Once we've stored our laptop details in our database, we perform two filtering operations, Filter Ultrabook Laptops and Filter Notebook Laptops. These filtering operations are execute SQL processors which will run SQL queries to extract Ultrabooks…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.