Administration of Confluent Apache Kafka Training Course

Module 1: Overview of Confluent Apache Kafka architecture and configuration

• The function of Kafka within modern data pipelines
• Distinguishing between Apache Kafka and Confluent Kafka
• Essential components: producers, consumers, brokers, topics, and partitions
• Deployment models for Kafka clusters and scaling factors

Module 2: Configuring Zookeeper Quorums

• Introduction to Zookeeper
• The function of Zookeeper within a Kafka cluster
• Determining Zookeeper Quorum size
• Zookeeper configuration specifics
• Setting up SSH on server environments
• Practical exercise: Configuring Zookeeper as both a team and a service
• Utilizing the Zookeeper Command Line Interface (CLI)
• Practical exercise: Zookeeper Quorum configuration
• Understanding the Zookeeper internal file system
• Performance factors impacting Zookeeper
• Demonstration of Zookeeper management tools and Zoonavigator

Module 3: Configuring Kafka Clusters

• Fundamental Kafka concepts
• General Kafka configuration
• Practical exercise: Configuring Kafka brokers
• Practical exercise: Running Kafka commands
• Practical exercise: Configuring multi-broker Kafka clusters
• Practical exercise: Testing Kafka clusters
• Verification of connectivity to the Kafka cluster
• Advertised.listeners configuration: a critical setting
• Topic configuration details
• Settings for downloading and ingesting messages within topics
• Practical exercise: Demonstrating Kafka resilience
• Kafka performance metrics: I/O
• Kafka performance metrics: Network (RED)
• Kafka performance metrics: RAM
• Kafka performance metrics: CPU
• Kafka performance metrics: Operating System (OS)
• Kafka performance: Other considerations
• Practical exercise: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configurations

• Configuration of Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
• Message transmission and reception via CLI, Java, and the Spring framework
• Monitoring metrics and utilizing tools such as Confluent Control Center and Elasticsearch
• Management of log files and offsets
• Strategies for high availability and disaster recovery
• Achieving high availability through replication
• Optimizing producer and consumer performance
• Formulating disaster recovery plans
• Controlling failover and recovering data
• Connector configuration
• Implementing Kafka Connect
• Implementing Kafka security features

Conclusion and Path Forward