Apache Airflow – a modern way to orchestrate tasks

Why take this course

Do you want to master one of the most popular open-source task orchestration tools? This training will introduce you to Apache Airflow as a central tool for conveniently orchestrating tasks across different platforms. You will learn the best practices and advanced techniques for working with this powerful tool.

What you'll learn

• How to understand Apache Airflow from a user’s perspective.
• How to test DAGs, build complex dependencies between tasks, and apply best practices for working with the tool.
• You’ll become fluent in the Airflow environment.
• You’ll be able to orchestrate data flows, understanding all the possibilities and limitations of the tool.

Certification & Exam

Upon completion of the training, you will receive a certificate of participation, confirming your skills in using the Apache Airflow tool. There is no final exam—all you need is active participation in the classes.

Who is this course for

This course is for data engineers looking to explore one of the most popular open-source task orchestration tools, Apache Airflow. Basic knowledge of Python is required.

Topics covered

• Apache Airflow – a new approach to task orchestration
• Theoretical introduction
  • Historical overview
  • Architecture overview
  • The most common use cases
• Construction of data flows
  • The concept of DAGs and the way of defining them
  • DAG testing
  • Operators – using existing ones and writing your own
  • Airflow REST API
  • Transferring information between tasks – Airflow XComs
  • Advanced ways of defining dependencies between tasks – Trigger Rules
  • Organization of tasks – SubDAGs and groups of tasks
  • Defining conditional relations between tasks – Branching