From the course: Microsoft Fabric Data Flows and Data Storage

Unlock the full course today

Join today to access over 24,400 courses taught by industry experts.

Challenge: Creating and using pipelines

Challenge: Creating and using pipelines

(upbeat music) - [Instructor] Data pipelines are the method which you'll be using to gather data from other sources and add them to your data lake in the raw area to start, and then format and model them with a goal of creating a curated model for use in enterprise reporting. In this challenge, you're going to be creating a new pipeline, WWI Retail, and in this new pipeline, you're going to be creating a new copy command and a new lakehouse. And then you're going to add a second copy command to the pipeline because that is really more like what you would do in the real world. You're going to be adding a number of different copy elements to your pipeline to create a solution. So the completed pipeline will have two copy elements inside of it, one for the employee and the other one to copy the city dimension. And you'll need to run the pipeline twice, the first time for the lakehouse creation and for the employee. And…

Contents