Relationship between service resources
With Yandex Managed Service for Apache Kafka®, you can deploy and maintain Apache Kafka® server clusters in the Yandex.Cloud infrastructure.
Apache Kafka® is a distributed inter-application communication system that uses the "publication-subscription" principle.
Each Managed Service for Apache Kafka® cluster consists of one or more broker hosts, where topics and their partitions are located. Cluster hosts may reside in different availability zones. More about the geo scope of Yandex.Cloud.
Clients connect to the cluster hosts. Clients are data producers and consumers. Producers send messages to certain cluster topics and consumers read messages from them. This ensures that you won't need to re-configure consumers if the producer changes.
Depending on the number of broker hosts in the cluster, ZooKeeper is automatically configured and hosted:
- If the Apache Kafka® cluster consists of one broker host, ZooKeeper is hosted on the same host.
- If the Apache Kafka® cluster consists of two or more broker hosts, ZooKeeper is hosted on three dedicated hosts. These hosts are added to the cluster automatically.
You can't change or delete ZooKeeper hosts. The number of ZooKeeper hosts is also fixed. Managed Service for Apache Kafka® uses ZooKeeper for storing cluster statuses and configurations.
The following characteristics are set for the ZooKeeper hosts by default:
For more information, see the documentation for Apache Kafka®.