Updating subclusters
You can perform the following actions for any subcluster:
Changing the number of hosts
You can change the number of hosts in DATANODE
and COMPUTENODE
clusters:
- In management console, select the folder with the cluster whose subcluster you want to change.
- Select Data Proc and the desired cluster.
- Go to Subclusters.
- Click for the appropriate subcluster and select Edit.
- Enter or select the required number of hosts in the Hosts field.
- Specify an optional decommissioning timeout.
- Click Save changes.
Data Proc runs the add host operation.
Change the host class
You can change the computing power of hosts in a separate subcluster:
To change the host class for a subcluster:
- In management console, select the folder with the cluster whose subcluster you want to change.
- Select Data Proc and the desired cluster.
- Go to Subclusters.
- Click for the appropriate subcluster and select Edit.
- Select the required platform and configuration under Host class.
- Specify an optional decommissioning timeout.
- Click Save changes.
Data Proc runs the update subcluster operation. Note that all the hosts in the updated subcluster will be restarted.
Changing the autoscaling rule for Compute subclusters
You can set up the autoscaling rule for COMPUTENODE
hosts:
- In the management console, select the folder with the cluster whose subcluster you want to update.
- Select Data Proc and the desired cluster.
- Go to Subclusters.
- Click for the appropriate subcluster and select Edit.
- Enter or select the minimum size of the scaling group in the Minimum number of hosts field.
- Enter or select the maximum size of the scaling group in the Maximum group size field.
- Set the utilization measurement period.
- Enter the instance warmup period in minutes or seconds.
- Enter the stabilization period.
- Set the target CPU performance level.
- Click Save changes.
Data Proc saves the autoscaling settings for the subcluster.
Increasing storage size
You can increase the amount of storage available to each host in a particular subcluster.
Note
Currently, you cannot reduce storage size. If necessary, re-create the Data Proc subcluster.
To change the storage size for a subcluster:
- In management console, select the folder with the cluster whose subcluster you want to change.
- Select Data Proc and the desired cluster.
- Go to Subclusters.
- Click for the appropriate subcluster and select Edit.
- Enter or select the required amount of storage under Storage size.
- Click Save changes.
Data Proc runs the update subcluster operation.