Yandex.Cloud
  • Services
  • Why Yandex.Cloud
  • Pricing
  • Documentation
  • Contact us
Get started
Yandex Data Proc
  • Use cases
    • Configuring networks for Data Proc clusters
    • Using Apache Hive
    • Running Spark applications
    • Running applications from a remote host
    • Copying files from Yandex Object Storage
  • Step-by-step instructions
    • All instructions
    • Creating clusters
    • Connecting to clusters
    • Updating subclusters
    • Managing subclusters
    • Deleting clusters
  • Concepts
    • Data Proc overview
    • Host classes
    • Hadoop and component versions
    • Component interfaces and ports
    • Component web interfaces
    • Auto scaling
    • Decommissioning subclusters and hosts
    • Network in Data Proc
    • Quotas and limits
  • Access management
  • Pricing policy
  • API reference
    • Authentication in the API
    • gRPC
      • Overview
      • ClusterService
      • JobService
      • ResourcePresetService
      • SubclusterService
      • OperationService
    • REST
      • Overview
      • Cluster
        • Overview
        • create
        • delete
        • get
        • list
        • listHosts
        • listOperations
        • listUILinks
        • start
        • stop
        • update
      • Job
        • Overview
        • create
        • get
        • list
        • listLog
      • ResourcePreset
        • Overview
        • get
        • list
      • Subcluster
        • Overview
        • create
        • delete
        • get
        • list
        • update
  • Questions and answers
  1. Step-by-step instructions
  2. Updating subclusters

Updating subclusters

  • Changing the number of hosts
  • Change the host class
  • Changing the autoscaling rule for Compute subclusters
  • Increasing storage size

You can perform the following actions for any subcluster:

  • Change the number of hosts.

  • Change the host class.

  • Change the autoscaling rule

  • Increase storage size.

Changing the number of hosts

You can change the number of hosts in DATANODE and COMPUTENODE clusters:

  1. In management console, select the folder with the cluster whose subcluster you want to change.
  2. Select Data Proc and the desired cluster.
  3. Go to Subclusters.
  4. Click for the appropriate subcluster and select Edit.
  5. Enter or select the required number of hosts in the Hosts field.
  6. Specify an optional decommissioning timeout.
  7. Click Save changes.

Data Proc runs the add host operation.

Change the host class

You can change the computing power of hosts in a separate subcluster:

Management console

To change the host class for a subcluster:

  1. In management console, select the folder with the cluster whose subcluster you want to change.
  2. Select Data Proc and the desired cluster.
  3. Go to Subclusters.
  4. Click for the appropriate subcluster and select Edit.
  5. Select the required platform and configuration under Host class.
  6. Specify an optional decommissioning timeout.
  7. Click Save changes.

Data Proc runs the update subcluster operation. Note that all the hosts in the updated subcluster will be restarted.

Changing the autoscaling rule for Compute subclusters

You can set up the autoscaling rule for COMPUTENODE hosts:

  1. In the management console, select the folder with the cluster whose subcluster you want to update.
  2. Select Data Proc and the desired cluster.
  3. Go to Subclusters.
  4. Click for the appropriate subcluster and select Edit.
  5. Enter or select the minimum size of the scaling group in the Minimum number of hosts field.
  6. Enter or select the maximum size of the scaling group in the Maximum group size field.
  7. Set the utilization measurement period.
  8. Enter the instance warmup period in minutes or seconds.
  9. Enter the stabilization period.
  10. Set the target CPU performance level.
  11. Click Save changes.

Data Proc saves the autoscaling settings for the subcluster.

Increasing storage size

You can increase the amount of storage available to each host in a particular subcluster.

Note

Currently, you cannot reduce storage size. If necessary, re-create the Data Proc subcluster.

Management console

To change the storage size for a subcluster:

  1. In management console, select the folder with the cluster whose subcluster you want to change.
  2. Select Data Proc and the desired cluster.
  3. Go to Subclusters.
  4. Click for the appropriate subcluster and select Edit.
  5. Enter or select the required amount of storage under Storage size.
  6. Click Save changes.

Data Proc runs the update subcluster operation.

In this article:
  • Changing the number of hosts
  • Change the host class
  • Changing the autoscaling rule for Compute subclusters
  • Increasing storage size
Language
Careers
Privacy policy
Terms of use
© 2021 Yandex.Cloud LLC