Skip to main content
HomeData Engineering

Introduction to Apache Airflow in Python

4.2+
54 reviews
Advanced

Learn how to implement and schedule data engineering workflows.

Start Course for Free
4 hours16 videos55 exercises42,206 learnersTrophyStatement of Accomplishment

Create Your Free Account

GoogleLinkedInFacebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.
Group

Training 2 or more people?

Try DataCamp for Business

Loved by learners at thousands of companies


Course Description

Now Updated to Apache Airflow 2.7 - Delivering data on a schedule can be a manual process. You write scripts, add complex cron tasks, and try various ways to meet an ever-changing set of requirements—and it's even trickier to manage everything when working with teammates. Apache Airflow can remove this headache by adding scheduling, error handling, and reporting to your workflows. In this course, you'll master the basics of Apache Airflow and learn how to implement complex data engineering pipelines in production. You'll also learn how to use Directed Acyclic Graphs (DAGs), automate data engineering workflows, and implement data engineering tasks in an easy and repeatable fashion—helping you to maintain your sanity.
For Business

Training 2 or more people?

Get your team access to the full DataCamp platform, including all the features.
DataCamp for BusinessFor a bespoke solution book a demo.

In the following Tracks

Certification Available

Data Engineer in Python

Go To Track
  1. 1

    Intro to Airflow

    Free

    In this chapter, you’ll gain a complete introduction to the components of Apache Airflow and learn how and why you should use them.

    Play Chapter Now
    Introduction to Apache Airflow
    50 xp
    Testing a task in Airflow
    50 xp
    Examining Airflow commands
    50 xp
    Airflow DAGs
    50 xp
    Defining a simple DAG
    100 xp
    Working with DAGs and the Airflow shell
    50 xp
    Troubleshooting DAG creation
    100 xp
    Airflow web interface
    50 xp
    Starting the Airflow webserver
    50 xp
    Navigating the Airflow UI
    50 xp
    Examining DAGs with the Airflow UI
    50 xp
For Business

Training 2 or more people?

Get your team access to the full DataCamp platform, including all the features.

In the following Tracks

Certification Available

Data Engineer in Python

Go To Track

collaborators

Collaborator's avatar
Hadrien Lacroix
Collaborator's avatar
Lis Sulmont

prerequisites

Intermediate PythonIntroduction to Shell
Mike Metzger HeadshotMike Metzger

Data Engineer Consultant @ Flexible Creations

Mike is a consultant focusing on data engineering and analysis using SQL, Python, and Apache Spark among other technologies. He has a 20+ year history of working with various technologies in the data, networking, and security space.
See More

Don’t just take our word for it

*4.2
from 54 reviews
56%
19%
20%
4%
2%
  • Nattakorn S.
    26 days

    Great and easy to learning every day

  • Javier F.
    3 months

    I would like to congratulate the presentation and delivery of the material, it is very well prepared, I was very satisfied.

  • Sety L.
    4 months

    This course clearly explains the concepts and usefulness of Apache Airflow. Moreover, it also includes helpful coding exercises for Python and CLI. This course strikes the perfect balance between theory, practice and skill level (it is both easy to get into and gets more advanced without being too hard).

  • Felipe L.
    4 months

    Deep content.

  • Erich H.
    4 months

    This is a very good course with the quality we expect and are used to seeing from DataCamp!!

"Great and easy to learning every day"

Nattakorn S.

"I would like to congratulate the presentation and delivery of the material, it is very well prepared, I was very satisfied."

Javier F.

"This course clearly explains the concepts and usefulness of Apache Airflow. Moreover, it also includes helpful coding exercises for Python and CLI. This course strikes the perfect balance between theory, practice and skill level (it is both easy to get into and gets more advanced without being too hard)."

Sety L.

Join over 15 million learners and start Introduction to Apache Airflow in Python today!

Create Your Free Account

GoogleLinkedInFacebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.