Confluent Apache Kafka: Cluster Operations and Configuration Training Course

Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration

• Overview of Apache Kafka and the Confluent Platform
• Core concepts of Kafka brokers, producers, consumers, and topics
• The significance of Kafka in data streaming and messaging workflows
• Confluent add-ons: REST Proxy, Schema Registry, and Control Center
• Kafka cluster architecture: understanding brokers, partitions, and replication

Module 2: Configuring Zookeeper Quorums

• Fundamentals of Zookeeper
• The function of Zookeeper within a Kafka cluster
• Determining Zookeeper quorum size
• Configuring Zookeeper parameters
• Implementing SSH connectivity on servers
• Hands-on: Configuring Zookeeper (both as a team and as a service)
• Utilizing the Zookeeper Command Line Interface (CLI)
• Hands-on: Establishing a Zookeeper quorum
• Exploring Zookeeper’s internal file system
• Performance variables impacting Zookeeper
• Demo: Zookeeper administration tools and Zoonavigator

Module 3: Configuring Kafka Clusters

• Foundational Kafka concepts
• Basics of Kafka configuration
• Hands-on: Configuring Kafka on a single broker
• Hands-on: Running Kafka commands
• Hands-on: Setting up a Kafka multi-broker (cluster) environment
• Hands-on: Conducting Kafka cluster tests
• Verifying connectivity to the Kafka cluster
• Configuring Advertised.listeners: critical settings
• Topic-level configurations
• Establishing message ingestion and delivery across topics
• Hands-on: Illustrating Kafka resilience
• Kafka performance considerations: I/O, network, RAM, CPU, and OS
• Kafka performance: additional influencing factors
• Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

• Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
• Message sending and receiving (via CLI, Java, and Spring Framework)
• Monitoring and metrics tools (Confluent Control Center, Elasticsearch, etc.)
• Managing log files and offsets
• Achieving high availability and disaster recovery
• Guaranteeing high availability through replication
• Performance optimization for producers and consumers
• Formulating disaster recovery strategies
• Controlling failover and recovering data
• Setting up connectors
• Implementing Kafka Connect
• Exploring Kafka security features

Summary and Future Steps