From the course: Introduction to Modern Data Engineering with Snowflake
Join today to access over 24,400 courses taught by industry experts.
What is orchestration? - Snowflake Tutorial
From the course: Introduction to Modern Data Engineering with Snowflake
What is orchestration?
There's so much more to understanding data pipelines beyond the three phases in our data engineering framework. In fact, if someone were to ask me, "What's the one key aspect of building a data pipeline that completely levels up the power and robustness of that pipeline? I'd certainly answer, "Automation." We'll dive into this concept in this module. Before getting into the details, here's the quick note on the ITD framework that we've used so far. This framework has made it easy for us to understand the core moving parts to a data pipeline. Thanks to the framework, we know that the core components of a data pipeline involve ingesting data, performing transformations against that data, and delivering the data product to a consumer. You've also learned how to use the most practical, powerful features in each of those phases to get you up and running fast with building data pipelines with Snowflake. With the exception of dynamic tables, much of what we've done so far has had little to…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.
