Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Configuration
- The strategic role of Kafka in contemporary data pipelines.
- Distinguishing between Apache Kafka and Confluent Kafka.
- Key architectural elements: producers, consumers, brokers, topics, and partitions.
- Deployment models and scalability considerations for Kafka clusters.
Module 2: Configuring Zookeeper Quorums
- An introduction to Zookeeper.
- The specific role of Zookeeper within a Kafka cluster ecosystem.
- Determining the appropriate Zookeeper Quorum size.
- Essential Zookeeper configuration parameters.
- Setting up SSH connectivity on target servers.
- Practical exercise: Configuring Zookeeper as both a team and a service.
- Utilizing the Zookeeper Command Line Interface (CLI).
- Practical exercise: Configuring a Zookeeper Quorum.
- Understanding the Zookeeper internal file system.
- Performance factors that influence Zookeeper efficiency.
- Demonstration of management tools for Zookeeper and Zoonavigator.
Module 3: Kafka Cluster Setup and Management
- Fundamental concepts in Kafka operations.
- Core Kafka configuration practices.
- Practical exercise: Configuring individual Kafka brokers.
- Practical exercise: Executing standard Kafka commands.
- Practical exercise: Setting up a multi-broker Kafka cluster.
- Practical exercise: Testing the integrity of the Kafka cluster.
- Verifying connectivity to the Kafka cluster.
- Mastering the Advertised.listeners setting: a critical configuration parameter.
- Topic-specific configuration options.
- Configuring message download and ingestion processes.
- Practical exercise: Demonstrating Kafka's resilience mechanisms.
- Performance optimization: I/O operations.
- Performance optimization: Network considerations (RED).
- Performance optimization: RAM utilization.
- Performance optimization: CPU usage.
- Performance optimization: Operating System (OS) level adjustments.
- Performance optimization: Other relevant factors.
- Practical exercise: Modifying Kafka broker configurations.
Module 4: Advanced Kafka Configurations
- Configuring Landoop Kafka UI, Confluent REST Proxy, and Confluent Schema Registry.
- Methods for sending and receiving messages via CLI, Java, and the Spring framework.
- Monitoring metrics using tools such as Confluent Control Center and Elasticsearch.
- Managing log files and consumer offsets.
- Strategies for high availability and disaster recovery.
- Achieving high availability through effective replication.
- Optimizing producer and consumer performance.
- Developing robust disaster recovery strategies.
- Controlling failover processes and managing data recovery.
- Configuring Kafka Connectors.
- Implementing Kafka Connect workflows.
- Integrating Kafka security features.
Course Summary and Recommended Next Steps
Requirements
- A solid grasp of distributed systems and messaging concepts.
- Proficiency with the Linux command line interface.
- A foundational knowledge of networking principles and system administration.
Target Audience
- System Administrators.
- DevOps Engineers.
- Platform and Infrastructure Teams.
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Francis's way of explaining is clear, presenting examples that help with the explanation
JUAN JOSE LOPEZ MARTINEZ - Bisih
Course - Apache Kafka for Developers
Machine Translated