Course objectives

Introducing Apache Airflow as a central tool for convenient orchestrating tasks between different platforms.

Benefits

Participants will learn and understand:

  • Apache Airflow from the user’s point of view
  • ways of testing DAGs, building complex dependencies between tasks and good practices of working with the tool

Participants will be able to:

  • be fluent in the environment,
  • orchestrate data flows knowing all the possibilities and limitations of the tool.
Training scope
  • Apache Airflow – a new approach to task orchestration
  • Theoretical introduction
    • Historical overview
    • Architecture overview
    • The most common use cases
  • Construction of data flows
    • The concept of DAGs and the way of defining them
    • DAG testing
    • Operators – using existing ones and writing your own
    • Airflow REST API
    • Transferring information between tasks – Airflow XComs
    • Advanced ways of defining dependencies between tasks – Trigger Rules
    • Organization of tasks – SubDAGs and groups of tasks
    • Defining conditional relations between tasks – Branching
Audience

Data engineers looking to explore one of the most popular Open Source task orchestration tools, Apache Airfow. Basic knowledge of Python is required.

The number of participants: 8-15 people

Duration: 1 day

Available language: PL / EN

Available course material: PL / EN

Course form
Presentation, workshop, exercises, discussion.

Download materials

Download

Thank You!

Sorry, something went wrong.

Please refresh the page and try again.

Processing...

Contact our expert with questions

about any of our trainings

Agnieszka Rzeczkowska

Training Practice Manager

CONTACT OUR EXPERT

Agnieszka Rzeczkowska

or drag and drop your file here

Allowed extensions: DOC, DOCX, PDF (max 5MB)

Thank you for filling out the form

We will look over your message and get back to you as soon as possible

Sorry, something went wrong and your message couldn’t be delivered

Please refresh the page and try again

Processing...

You might also like

Big DataCloud

AWS - designing of Big Data Systems

Duration:
2 days
Big Data

Apache Hadoop - data oriented system

Duration:
2 days
Big Data

Apache Kafka - Stream data processing

Duration:
2 days
Big Data

Apache Spark - building systems for real-time data processing

Duration:
2 days

ITIL® and PRINCE2® are registered trademarks of AXELOS Limited, used under permission of AXELOS Limited. All rights reserved.
AgilePM® is a registered trademark of Agile Business Consortium Limited.
All AgilePM® Courses are offered by Sii, an Affiliate of Quint Wellington Redwood, an Accredited Training Organization of The APM Group Ltd.
Lean IT® Association is a registered trademark of the Lean IT Association LLC. All rights reserved. Sii is an Affiliate of Accredited Training OrganizationQuint Wellington Redwood.
All prices presented on the website are net prices. 23% VAT should be added.

SUBMIT

Ta treść jest dostępna tylko w jednej wersji językowej.
Nastąpi przekierowanie do strony głównej.

Czy chcesz opuścić tę stronę?

Einige Inhalte sind nicht in deutscher Sprache verfügbar.
Sie werden dann auf die englische Sprachversion der Website weitergeleitet.

Möchten Sie fortsetzen?