1. All topics
  2. Technology
  3. Data Science
  4. Data Engineering
Hands-On Introduction: Data Engineering Preview

Hands-On Introduction: Data Engineering

With Vinoo Ganesh Liked by 862 users
Duration: 1h 33m Skill level: Beginner Released: 4/28/2023

Start my 1-month free trial Buy for my team

Course details

Suggested prerequisites

  • Know basic Python data types, control structures, functions, and classes.
  • Have a good enough understanding of SQL to write queries to extract, transform, and load data in Apache Airflow pipelines.
  • Have some knowledge of Bash script or Unix for basic Airflow installation and administration.
  • Be familiar with text editors.
  • Know some of the basic principles behind cloud computing.

Projects

  • Author, import, and execute a basic one-task DAG in Airflow: one Python file with one DAG and one task.
  • Author, import, and execute a basic two-task DAG in Airflow, where one task depends on the completion of another task.
  • Build a DAG to analyze top-level domains.

In this course, instructor Vinoo Ganesh gives you an overview of the fundamental skills you need to become a data engineer. Learn how to solve complex data problems in a scalable, concrete way. Explore the core principles of the data engineer toolkit—including ELT, OLTP/OLAP, orchestration, DAGs, and more—as well as how to set up a local Apache Airflow deployment and full-scale data engineering ETL pipeline. Along the way, Vinoo helps you boost your technical skill set using real-world, hands-on scenarios.

This course is integrated with GitHub Codespaces, an instant cloud developer environment that offers all the functionality of your favorite IDE without the need for any local machine setup. With GitHub Codespaces, you can get hands-on practice from any machine, at any time—all while using a tool that you’ll likely encounter in the workplace. Check out the “Using GitHub Codespaces with this course” video to learn how to get started.

This course is part of a Professional Certificate from Astronomer.

Skills you’ll gain

Earn a sharable certificate

Share what you’ve learned, and be a standout professional in your desired industry with a certificate showcasing your knowledge gained from the course.

Sample certificate

Certificate of Completion

  • Showcase on your LinkedIn profile under “Licenses and Certificate” section

  • Download or print out as PDF to share with others

  • Share as image online to demonstrate your skill

Meet the instructor

Learner reviews

4.6 out of 5

587 ratings
  • 5 star
    Current value: 446 76%
  • 4 star
    Current value: 96 16%
  • 3 star
    Current value: 31 5%
  • 2 star
    Current value: 7 1%
  • 1 star
    Current value: 7 1%
  • Berlin Tampubolon Berlin Tampubolon

    Berlin Tampubolon

    Manager at PT. Hutama Karya (Persero)

    5/5 February 5, 2025
    good
    Helpful · Report
  • Jason Cooper Smith Jason Cooper Smith

    Jason Cooper Smith

    CDL Delivery Driver

    3/5 January 14, 2025
    Although the use of airflow itself is exciting, this course has been frustratingly long to get through. The flow of learning is continually interrupted, which has included dealing with bugs, working out unclear unix commands, and journeying through an outdated (by 1.5 years) Airflow installation process, all which the instructor's team could/should have included in this course with medium to small effort on his part, otherwise it's a lot of effort on ours. I understand that learning is effort, but the frustration I've felt in dealing with the hiccups in this course was enough for me to set the computer down and go work on something else. Again, I like Airflow. The concept is cool, and the last section is actually fun to do. But the setup sections in this course felt like a disaster. Could just be my opinion. However, for me, it took away from the learning experience.
    Helpful · Report
  • Raphael Oyelami Raphael Oyelami

    Raphael Oyelami

    Data Analyst || Leveraging Excel, SQL, & Python to Drive Data-Driven Insights and Scalable Cloud Solutions || AWS CCP Certified || Focused on…

    5/5 December 31, 2024
    I have learnt a lot from this course. Due to the practical example, I was able to practice what was being taught and it gave me a better understanding on how Airflow works.
    Helpful · Report

Contents

What’s included

  • Test your knowledge 3 quizzes
  • Learn on the go Access on tablet and phone

Similar courses

Download courses

Use your iOS or Android LinkedIn Learning app, and watch courses on your mobile device without an internet connection.

Download on the App Store Get it on Google Play