AWS – designing of Big Data Systems

Course objectives

A practical approach to designing and building “Big Data – Datalake” systems based on the AWS platform.

Benefits

Participants will learn and understand:

• A practical approach to designing solutions on the AWS platform
• Services provided by the AWS platform
• How to build modern systems based on the AWS platform

Participants will gain detailed knowledge about the AWS platform enabling:

• Designing advanced solutions
• Designing modern Big Data systems
• Building reliable systems

Training scope

• Introduction to cloud computing
• AWS basics:
  • Basic concepts
  • AWS products
  • Introduction to environment design
  • Creating systems with high availability
  • Scaling of environments
  • Automation
• “Well-Architected Framework” – a tool for designing environments on AWS, according to the main pillars:
  • Interoperability
  • Security
  • Reliability
  • Efficiency
  • Cost optimization
• Designing Big Data systems on the AWS platform
  • Amazon EMR cluster configuration
  • Data storage on the AWS platform
  • Real-time data processing with Apache Spark and Amazon Kinesis
  • Application of Apache Pig, Hive in Amazon EMR
  • Creating ETL using AWS Glue
  • Analysis of Amazon Redshift data
  • Monitoring and Audit

Audience

All people involved in the process of designing and building system architecture. Designers and architects with experience in building complex systems.