Apache Kafka – Stream data processing

Course objectives

An introduction to creating real-time systems and building stream architecture based on the Apache Kafka platform.

Benefits

Participants will learn and understand:

• A practical approach to stream programming
• Key mechanisms of the Apache Kafka platform
• Programming environment
• Principles of building stream architecture

Participants will be able to:

• Create applications using Apache Kafka
• Install and administrate the Apache Kafka platform
• Perform stream data processing

Training scope

•  Apache Kafka platform – architecture
  • Platform construction
  • Details of platform operation
•  Installation
  • Preparation of the development environment
  • Installation and configuration of the Apache Kafka broker
  • Docker with Apache Kafka
  • Preparation of the production environment
  • Construction and configuration of the Apache Kafka cluster
• Administration and monitoring
  • Basic broker management
  • Partition management
  • Metrics and monitoring of brokers
•  Kafka Producers
  • Configuration
  • Synchronous and asynchronous sending of messages
  • Serializers and work with partitions
• Kafka Consumers
  • Configuration
  • Reading messages
  • Offset and Commit management
• Kafka Streams
  • The concept of stream processing
  • Project patterns
  • Architecture of Apache Kafka Streams
• Practical exercises – building a sample application.

Audience

All people involved in the software development process, members of project teams.

Programmers who know rules of creating object-oriented or functional software in Java or Scala.