Course objectives

Introduction to creating real-time systems and building stream architecture based on the Apache Spark platform.

Benefits

Participants will learn and understand:

  • A practical approach to stream programming
  • Basics of the Apache Kafka platform
  • Apache Spark architecture
  • Programming environment
  • Principles of building stream architecture

Participants will be able to:

  • Creating applications using Apache Kafka and Spark
  • Creating applications that process large amounts of data
Training scope
  •  Fundamentals of Data Engineering
    • Data engineering
    • MapReduce algorithm
    • BigTable model
  •  Installation
    • Preparation of the development environment
    • Apache Spark startup methods
  • Apache Spark platform – architecture
    • Platform construction
    • Details of the platform operation
  • Apache Spark
    • RDDs, DataFrames and DataSets
    • Spark SQL
    • Joins
  • Introduction to Apache Kafka®
    • Platform construction
    • Apache Kafka® broker installation
    • Kafka Producers
    • Kafka Consumers
    • Serializers
  • Spark Streaming
  • Testing
Audience

All people involved in the software development process, members of project teams.

Programmers who know rules of creating object-oriented or functional software in Java or Scala.

The number of participants: 8-15 people

Duration: 2 days

Available language: PL / EN

Available course material: PL / EN

Course form
Presentation, workshop, exercises, discussion

Download materials

Download

Thank You!

Sorry, something went wrong.

Please refresh the page and try again.

Processing...

Contact our expert with questions

about any of our trainings

Agnieszka Rzeczkowska

Training Practice Manager

CONTACT OUR EXPERT

Agnieszka Rzeczkowska

or drag and drop your file here

Allowed extensions: DOC, DOCX, PDF (max 5MB)

Thank you for filling out the form

We will look over your message and get back to you as soon as possible

Sorry, something went wrong and your message couldn’t be delivered

Please refresh the page and try again

Processing...

You might also like

Big DataCloud

AWS - designing of Big Data Systems

Duration:
2 days
Big Data

Apache Hadoop - data oriented system

Duration:
3 days
Big Data

Apache Kafka - Stream data processing

Duration:
2 days

ITIL® and PRINCE2® are registered trademarks of AXELOS Limited, used under permission of AXELOS Limited. All rights reserved.
AgilePM® is a registered trademark of Agile Business Consortium Limited.
All AgilePM® Courses are offered by Sii, an Affiliate of Quint Wellington Redwood, an Accredited Training Organization of The APM Group Ltd.
Lean IT® Association is a registered trademark of the Lean IT Association LLC. All rights reserved. Sii is an Affiliate of Accredited Training OrganizationQuint Wellington Redwood.
All prices presented on the website are net prices. 23% VAT should be added.

SUBMIT

Einige Inhalte sind nicht in deutscher Sprache verfügbar.
Sie werden dann auf die englische Sprachversion der Website weitergeleitet.

Möchten Sie fortsetzen?