Scaling a function
Incoming requests are processed by the function one at a time. If the function is called faster than one instance can process the request, Cloud Functions scales the function by running additional function instances. You can set the following:
zone_instances_limit
: Number of function instances in an availability zone.zone_requests_limit
: Number of concurrent function calls in an availability zone.
Note
Function calls are distributed across availability zones randomly. Cloud Functions does not guarantee their even distribution across zones. For example, all calls, regardless of their number, might end up in the same zone.
When the number of function instances reaches the zone_instances_limit
, Cloud Functions stops scaling it. If there are more function calls than instances available, the call is queued and treated as a call-in-progress. When the number of calls-in-progress reaches the zone_requests_limit
, the service stops queuing calls and returns the 429 TooManyRequests
error.
You can configure different scaling settings for different function versions using tags. Scaling settings will be valid for the function version that the specified tag is assigned to. Function versions are scaled independently of each other.
The scaling settings must be within the quotas. If the setting value is zero, the function is scaled within the quotas.
Viewing scaling settings
- In the management console, select the folder containing your function.
- Select Cloud Functions.
- Select a function.
- Under Version history, mouse over the version tag of the function (such as,
$latest
) whose scaling settings you wish to view. - Information on these scaling settings will be displayed in a pop-up window:
- zone_instances_limit: Number of function instances in an availability zone.
- zone_requests_limit: Number of concurrent function calls in an availability zone.
If you don't have the Yandex Cloud command line interface yet, install and initialize it.
The folder specified in the CLI profile is used by default. You can specify a different folder using the --folder-name
or --folder-id
parameter.
To view a function's scaling settings, run the command:
yc serverless function list-scaling-policies --id=d4eokpuol55h********
Where --id
is the function ID. To find out the ID, request a list of functions.
Result:
+----------------------+---------+----------------------+---------------------+
| FUNCTION ID | TAG | ZONE INSTANCES LIMIT | ZONE REQUESTS LIMIT |
+----------------------+---------+----------------------+---------------------+
| d4eokpuol55hmj15k7g1 | $latest | 1 | 2 |
+----------------------+---------+----------------------+---------------------+
You can view a function's scaling settings using the listScalingPolicies.
You can view function scaling settings using the Yandex Cloud Toolkit plugin for the IDE family on the IntelliJ platform from JetBrains.
Adding scaling settings
- In the management console, select the folder containing your function.
- Select Cloud Functions.
- Select a function.
- Under Version history, mouse over the version tag of the function (such as,
$latest
) you wish to add scaling settings for. - In the pop-up window, click Add.
- In the window that opens, specify:
- zone_instances_limit: Number of function instances in an availability zone.
- zone_requests_limit: Number of concurrent function calls in an availability zone.
- Click Save.
To add scaling settings for a function, run the command:
yc serverless function set-scaling-policy \
--id=d4eokpuol55h******** \
--tag=\$latest \
--zone-instances-limit=1 \
--zone-requests-limit=2
Where:
--id
: Function ID. To find out the ID, request a list of functions.--tag
: Function version tag.--zone-instances-limit
: Number of function instances.--zone-requests-limit
: Number of calls-in-progress.
Result:
function_id: d4eokpuol55h********
tag: $latest
zone_instances_limit: "1"
zone_requests_limit: "2"
With Terraform, you can quickly create a cloud infrastructure in Yandex Cloud and manage it by configuration files. They store the infrastructure description in HashiCorp Configuration Language (HCL). Terraform and its providers are distributed under the Mozilla Public License.
For more information about the provider resources, see the documentation on the Terraform site or mirror site.
If you change the configuration files, Terraform automatically determines which part of your configuration is already deployed and what should be added or removed.
If you don't have Terraform, install it and configure the Yandex Cloud provider.
To add scaling settings:
-
In the configuration file, describe the parameters of resources that you want to create:
yandex_function_scaling_policy
: Description of function scaling settings:function_id
: Function ID.policy
: Scaling settings:policy.0.tag
: Function version tag.policy.0.zone_instances_limit
: Number of function instances.policy.0.zone_requests_limit
: Number of calls in progress.
Example configuration file structure:
provider "yandex" { token = "<service account OAuth or static key>" folder_id = "<folder ID>" zone = "ru-central1-a" } resource "yandex_function_scaling_policy" "my_scaling_policy" { function_id = "are1samplefu********" policy { tag = "$latest" zone_instances_limit = 2 zone_requests_limit = 1 } }
For more information about the resources you can create using Terraform, see the provider documentation.
-
Make sure that the configuration files are correct.
- In the command line, go to the directory where you created the configuration file.
- Run the check using the command:
terraform plan
If the configuration is described correctly, the terminal displays a list of created resources and their parameters. If there are errors in the configuration, Terraform points them out.
-
Deploy the cloud resources.
- If the configuration doesn't contain any errors, run the command:
terraform apply
- Confirm that you want to create the resources.
Afterwards, all the necessary resources are created in the specified folder. You can check that the resources are there with the correct settings using the management console.
- If the configuration doesn't contain any errors, run the command:
You can add scaling settings for a function using the setScalingPolicy.
You can add function scaling settings using the Yandex Cloud Toolkit plugin for the IDE family on the IntelliJ platform from JetBrains.
Deleting scaling settings
- In the management console, select the folder containing your function.
- Select Cloud Functions.
- Select a function.
- Under Version history, mouse over the version tag of the function (such as,
$latest
) which you wish to delete scaling settings for. - In the pop-up window, click Change.
- To delete a scaling setting, set it equal to zero.
- Click Save.
To delete a function's scaling settings, run the command:
yc serverless function remove-scaling-policy \
--id=d4eokpuol55h******** \
--tag=\$latest
Where:
You can delete scaling settings for a function using the removeScalingPolicy.
You can delete function scaling settings using the Yandex Cloud Toolkit plugin for the IDE family on the IntelliJ platform from JetBrains.