Relationship between service resources
With Yandex Managed Service for Apache Kafka®, you can deploy and maintain Apache Kafka® server cluster versions 2.1 and 2.6 in the Yandex.Cloud infrastructure.
Apache Kafka® is a distributed publish-subscribe messaging system for streaming data between applications.
Each Managed Service for Apache Kafka® cluster consists of one or more broker hosts, where topics and their partitions are located. Cluster hosts may reside in different availability zones. More about the geo scope of Yandex.Cloud.
Clients connect to the cluster hosts. Clients are data producers and consumers. Producers send messages to certain cluster topics and consumers read messages from them. This ensures that you won't need to re-configure consumers if the producer changes.
Depending on the number of broker hosts in the cluster, ZooKeeper is automatically configured and hosted:
- If the Apache Kafka® cluster consists of one broker host, ZooKeeper is hosted on the same host.
- If the Apache Kafka® cluster consists of two or more broker hosts, ZooKeeper is hosted on three dedicated hosts. These hosts are added to the cluster automatically.
You can't delete ZooKeeper hosts. The number of ZooKeeper hosts is fixed. Managed Service for Apache Kafka® uses ZooKeeper for storing cluster statuses and configurations.
You can change the ZooKeeper host parameters using the CLI.
The following characteristics are set for the ZooKeeper hosts by default:
For more information, see the documentation for Apache Kafka®.