Overview of Kafka Development
This training gives you an overall training around the development of open source stream processing software called Kafka. This program will give you insights of integrating Kafka with Big Data, HDFS, and MapReduce, Zookeeper, Strom and Spark.
Please find below the objective of this program:
- Understanding of Big Data and Real-Time Big Data
- Understanding of Apache Hadoop
- Zookeeper Installation and configuration
- Understanding Kafka Architecture
Duration
2 Days
Prerequisite for Kafka Development
Basic understanding of Big Data tools.
Course Outline for Kafka Development
Lesson-1
- Introduction: Big Data & Real-Time Big Data
- 3Vs: Big Data
- Data evolution & characteristics: Big Data Industry Examples
Lesson-2
- Introduction: Big Data & Real-Time Big Data
- Apache Hadoop: HDFS & MapReduce
- Real-time: Big Data analysis, STORM & SPARK
Lesson-3
- Introduction: Zookeeper
- Introducing Zookeeper
- Zookeeper Recipes
- Zookeeper installation and configuration
- Demo 1 – Installing Ubuntu VM & connecting with Putty
Lesson-4
- Kafka Introduction & Architecture
- Introducing Kafka
- Kafka Architecture
- Message Queues
Lesson-5
- Kafka Introduction & Architecture
- Publish subscribe
- Kafka partitions
Lesson-6
- Kafka Installation, Configuration & Datamodel
- Kafka Installation
- Kafka configuration
Lesson-7
- Kafka Installation, Configuration & Data model
- Kafka cluster setup
- Starting Kafka
- Demo 2 – Installing & configuring Zookeeper and Kafka
Lesson-8
- Kafka interfaces
- Java interface to Kafka
- Compiling Java program for Kafka