Apache Airflow – a modern way to orchestrate tasks

Training to get to know the Apache Airflow tool, which is one of the most frequently chosen Open Source solutions for data flow orchestration.

Course objectives

Introducing Apache Airflow as a central tool for convenient orchestrating tasks between different platforms.

Benefits

Participants will learn and understand:

Apache Airflow from the user’s point of view
ways of testing DAGs, building complex dependencies between tasks and good practices of working with the tool

Participants will be able to:

be fluent in the environment,
orchestrate data flows knowing all the possibilities and limitations of the tool.

Training scope

Apache Airflow – a new approach to task orchestration
Theoretical introduction
- Historical overview
- Architecture overview
- The most common use cases
Construction of data flows
- The concept of DAGs and the way of defining them
- DAG testing
- Operators – using existing ones and writing your own
- Airflow REST API
- Transferring information between tasks – Airflow XComs
- Advanced ways of defining dependencies between tasks – Trigger Rules
- Organization of tasks – SubDAGs and groups of tasks
- Defining conditional relations between tasks – Branching

Audience

Data engineers looking to explore one of the most popular Open Source task orchestration tools, Apache Airfow. Basic knowledge of Python is required.

Course objectives

Introducing Apache Airflow as a central tool for convenient orchestrating tasks between different platforms.

Benefits

Participants will learn and understand:

Apache Airflow from the user’s point of view
ways of testing DAGs, building complex dependencies between tasks and good practices of working with the tool

Participants will be able to:

be fluent in the environment,
orchestrate data flows knowing all the possibilities and limitations of the tool.

Training scope

Apache Airflow – a new approach to task orchestration
Theoretical introduction
- Historical overview
- Architecture overview
- The most common use cases
Construction of data flows
- The concept of DAGs and the way of defining them
- DAG testing
- Operators – using existing ones and writing your own
- Airflow REST API
- Transferring information between tasks – Airflow XComs
- Advanced ways of defining dependencies between tasks – Trigger Rules
- Organization of tasks – SubDAGs and groups of tasks
- Defining conditional relations between tasks – Branching

Audience

Data engineers looking to explore one of the most popular Open Source task orchestration tools, Apache Airfow. Basic knowledge of Python is required.

The number of participants: 8-15 people

Duration: 1 day

Available language: PL / EN

Available course material: PL / EN

Course form

Presentation, workshop, exercises, discussion.

Download materials

Download

First name*

Surname*

E-mail*

I consent to the processing of my personal data by Sii sp. z o.o. and its subsidiaries for the purpose of sending marketing information to the provided e-mail address.

At any time, you may withdraw your consent to the processing of personal data, but such withdrawal shall not affect the legal compliance of any processing of such data, which had occurred before you withdrew your consent. Detailed information on the processing of your personal data is specified in the Privacy Policy.

Thank You!

Sorry, something went wrong.

Please refresh the page and try again.

File upload error

No file was uploaded

Incorrect file size (max 5MB)

Invalid file format

Empty file

Processing...

Download materials

Download

Contact our experts with questions about any of our trainings

Natalia & Agata

Training Practice Team

Contact our experts

Natalia & Agata

First name*

Surname*

E-mail*

Phone number

Company name

Job position

Your message*

Your file

Uploaded file:

danieltroc.pdf

Allowed extensions: DOC, DOCX, PDF (max 5MB)

I consent to the processing of my personal data by Sii sp. z o.o. and its subsidiaries for the purpose of sending marketing information to the provided e-mail address. I consent to the processing of my personal data by Sii sp. z o.o. and its subsidiaries for recruitment purposes.

Development of a new product lifecycle management system

Ingenico Axis Roadmap Team

Software for real-time DNA image analysis

Improvement of test automation by DMI Robot

Sii Sweden

Sii Ukraine

Sii Poland is the largest IT services provider in Poland according to the ITwiz Best100 report for 2023

Get ready for the Get Digital Summit 2024! Register now and take your technology knowledge to the next level.

Digital Health and Care and Regulatory Affairs. Learn how to effectively connect health and business for the benefit of patients

The closer we are to those in need, the more we want to help – discover how Michał, Test and Analysis Engineer at Sii, used his problem-solving skills to help effectively

Performance Engineering Meetup

Design your IoT device with cybersecurity in mind. Regulations, challenges, solutions

Get Digital Summit

How to achieve business agility? SAFe success patterns and real-world case studies

What did the internship at Sii's Engineering Competency Center give me?

SAP MM – basic configuration process and new organization units within existing organization

Adobe Edge Delivery Services – easy creation of ultra-fast pages

Using structures as composite keys in C# dictionaries

Apache Airflow – a modern way to orchestrate tasks

Course objectives

Benefits

Training scope

Audience

Download materials