Get in Touch
 Duration 16 hours

Course Outline

Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration

  • Overview of Apache Kafka and the Confluent Platform
  • Fundamentals of Kafka brokers, producers, consumers, and topics
  • The role of Kafka in data streaming and messaging pipelines
  • Confluent extensions: REST Proxy, Schema Registry, and Control Center
  • Kafka cluster architecture: understanding brokers, partitions, and replication

Module 2: Zookeeper Quorum Configuration

  • Introduction to Zookeeper
  • Zookeeper’s function within a Kafka cluster
  • Determining Zookeeper quorum size
  • Zookeeper configuration details
  • Implementing SSH on servers
  • Hands-on: Configuring Zookeeper as a team and as a service
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Setting up a Zookeeper quorum
  • Zookeeper’s internal file system structure
  • Performance factors influencing Zookeeper
  • Demo: Managing Zookeeper with tools and Zoonavigator

Module 3: Kafka Cluster Configuration

  • Core Kafka concepts
  • Detailed Kafka configuration
  • Hands-on: Configuring Kafka on a single broker
  • Hands-on: Running Kafka commands
  • Hands-on: Setting up a multi-broker Kafka cluster
  • Hands-on: Testing the Kafka cluster
  • Verifying connectivity to the Kafka cluster
  • Configuring Advertised.listeners: key settings
  • Topic configuration details
  • Setting up message ingestion and delivery within topics
  • Hands-on: Demonstrating Kafka resilience
  • Kafka performance: I/O, network, RAM, CPU, and OS considerations
  • Kafka performance: additional influencing factors
  • Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Messaging via CLI, Java, and Spring Framework
  • Utilizing metrics and monitoring tools (e.g., Confluent Control Center, Elasticsearch)
  • Managing log files and offsets
  • High availability and disaster recovery strategies
  • Achieving high availability through replication
  • Performance tuning for producers and consumers
  • Disaster recovery planning
  • Controlling failover and recovering data
  • Connector setup procedures
  • Implementing Kafka Connect
  • Integrating Kafka security features

Summary and Next Steps

Requirements

  • Practical experience with Linux-based systems and command-line interfaces
  • Familiarity with distributed systems concepts
  • Basic understanding of networking principles and system configuration

Target Audience

  • DevOps and SRE teams overseeing Kafka deployments
  • System administrators managing Confluent and Zookeeper infrastructure
  • Kafka developers and architects focused on scalable system design

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories