Get in Touch
 Duration 21 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

  • The strategic role of Kafka in contemporary data pipelines.
  • Distinguishing between Apache Kafka and Confluent Kafka.
  • Key architectural elements: producers, consumers, brokers, topics, and partitions.
  • Deployment models and scalability considerations for Kafka clusters.

Module 2: Configuring Zookeeper Quorums

  • An introduction to Zookeeper.
  • The specific role of Zookeeper within a Kafka cluster ecosystem.
  • Determining the appropriate Zookeeper Quorum size.
  • Essential Zookeeper configuration parameters.
  • Setting up SSH connectivity on target servers.
  • Practical exercise: Configuring Zookeeper as both a team and a service.
  • Utilizing the Zookeeper Command Line Interface (CLI).
  • Practical exercise: Configuring a Zookeeper Quorum.
  • Understanding the Zookeeper internal file system.
  • Performance factors that influence Zookeeper efficiency.
  • Demonstration of management tools for Zookeeper and Zoonavigator.

Module 3: Kafka Cluster Setup and Management

  • Fundamental concepts in Kafka operations.
  • Core Kafka configuration practices.
  • Practical exercise: Configuring individual Kafka brokers.
  • Practical exercise: Executing standard Kafka commands.
  • Practical exercise: Setting up a multi-broker Kafka cluster.
  • Practical exercise: Testing the integrity of the Kafka cluster.
  • Verifying connectivity to the Kafka cluster.
  • Mastering the Advertised.listeners setting: a critical configuration parameter.
  • Topic-specific configuration options.
  • Configuring message download and ingestion processes.
  • Practical exercise: Demonstrating Kafka's resilience mechanisms.
  • Performance optimization: I/O operations.
  • Performance optimization: Network considerations (RED).
  • Performance optimization: RAM utilization.
  • Performance optimization: CPU usage.
  • Performance optimization: Operating System (OS) level adjustments.
  • Performance optimization: Other relevant factors.
  • Practical exercise: Modifying Kafka broker configurations.

Module 4: Advanced Kafka Configurations

  • Configuring Landoop Kafka UI, Confluent REST Proxy, and Confluent Schema Registry.
  • Methods for sending and receiving messages via CLI, Java, and the Spring framework.
  • Monitoring metrics using tools such as Confluent Control Center and Elasticsearch.
  • Managing log files and consumer offsets.
  • Strategies for high availability and disaster recovery.
  • Achieving high availability through effective replication.
  • Optimizing producer and consumer performance.
  • Developing robust disaster recovery strategies.
  • Controlling failover processes and managing data recovery.
  • Configuring Kafka Connectors.
  • Implementing Kafka Connect workflows.
  • Integrating Kafka security features.

Course Summary and Recommended Next Steps

Requirements

  • A solid grasp of distributed systems and messaging concepts.
  • Proficiency with the Linux command line interface.
  • A foundational knowledge of networking principles and system administration.

Target Audience

  • System Administrators.
  • DevOps Engineers.
  • Platform and Infrastructure Teams.

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories