Get started
Yandex Managed Service for Elasticsearch

Creating clusters

A Managed Service for Elasticsearch cluster is a group of multiple linked Elasticsearch hosts. A cluster provides high search performance by distributing search and indexing tasks across all cluster hosts with the Data node role. To learn more about roles in the cluster, see Host roles.

Creating a cluster

When creating a cluster, parameters are specified separately for the hosts with the Master node role and for the hosts with the Data node role.

You can use hosts only with the Data node role, without creating dedicated hosts for the Master node role. In this case, hosts with the Data node role combine the two roles.

  1. In the management console, select the folder where you want to create a cluster.

  2. Select Managed Service for Elasticsearch.

  3. Click Create cluster.

  4. Under Basic parameters:

    1. Enter a name for the cluster and, if necessary, a description. The cluster name must be unique within the folder.
    2. Select the environment where you want to create the cluster (you can't change the environment once the cluster is created):
      • PRODUCTION: For stable versions of your apps.
      • PRESTABLE: For testing, including the Managed Service for Elasticsearch service itself. The Prestable environment is first updated with new features, improvements, and bug fixes. However, not every update ensures backward compatibility.
    3. Select the Elasticsearch version. The current supported version is 7.6.

  5. Under Network settings, select network.

  6. Under User, specify the admin user password.

    This is a special user that is needed to manage clusters and cannot be deleted. It's assigned the superuser role and can perform any operations on clusters.

    Tip

    To perform routine tasks, we recommend creating individual users. For more information, see Managing Elasticsearch users.

  7. Configure hosts with the Data node role by opening the Data node tab:

    1. Under Host class, select the platform, host type, and host class.

      The host class defines the technical characteristics of virtual machines that Elasticsearch nodes are deployed on. All available options are listed in Host classes. When you change the host class for the cluster, the characteristics of all existing instances change, too.

    2. Under Storage:

      1. Select the type of storage, either a more flexible network type (network-hdd or network-ssd) or faster local SSD storage (local-ssd).
      2. Select the size of storage to be used for data. The size of the local storage can only be changed in 100 GB increments.

    3. Under Hosts, select the configuration of hosts created together with the cluster.

      1. To add a host, click Add host.
      2. To change the added host, hover over the host line and click .

      When changing the host, you can:

      1. Select the availability zone and subnet.

      2. Enable public access. If public access is enabled for the Elasticsearch host with the Data node role, you can connect to this Elasticsearch host or Kibana on the host over the internet. To learn more, see Connecting to clusters.

        Tip

        If you can't request public access to the hosts (for example, for security reasons), you can use Kibana by proxying the connections via the virtual machine in Yandex Compute Cloud that is hosted in the same network as the cluster. For more information, see Connecting to clusters.

  8. If necessary, configure the hosts with the Master node role by opening the Master node tab:

    1. Under Host class, select the platform, host type, and host class.

    2. Under Storage, configure storage the same way as for hosts with the Data node role.

    3. Under Hosts, click Add hosts. Three hosts are added. To change one of the added hosts, hover over the host line and click .

      When changing the host, you can:

      1. Select the availability zone and subnet.

      2. Enable public access.

        Tip

        It's not recommended to enable public access for hosts with the Master node role. Change this setting only if you know exactly what you want to do.

  9. Click Create.

To create a cluster, use the API create method and pass the following in the request:

  • In the folderId parameter, the ID of the folder where the cluster should be placed.
  • The cluster name, in the name parameter.
  • Cluster configuration, in the configSpec parameter, including:
    • Class of hosts with the Master node role, in the configSpec.elasticsearchSpec.masterNode.resources parameter. If you don't want to create dedicated hosts with the Master node role, don't set values for the group of configSpec.elasticsearchSpec.masterNode parameters.
    • Class of hosts with the Data node role, in the configSpec.elasticsearchSpec.dataNode.resources parameter.
  • Configuration of the cluster hosts, in one or more hostSpecs parameters.
  • Network ID, in the networkId parameter.