You can use DataSphere to deploy trained models as microservices and grant third-party resources access to them.
Models are deployed on instances: virtual machines that preserve the interpreter state and the model code.
For load balancing, instances are combined into nodes: isolated groups of virtual machines. The API is used to access the node.
Nodes from cells with Python code
To create a node from a cell with Python code, save a checkpoint with the desired interpreter state. The API will be generated automatically based on the variables you selected when creating the node.
API requests can change the state of the node's interpreter. You can't revert to the original state without recreating the node.
Read more about creating a node from a cell with Python code in Creating a node from a Python code cell.
Statuses of nodes and their instances
Node instances can have one of the following statuses:
HEALTHY: The instance is healthy and available for balancing.
UNHEALTHY: There are issues with the instance, it's been excluded from balancing.
CREATED: A VM has been created for the instance.
STARTED: A connection has been established with the instance's VM.
PREPARING: The instance is being prepared for processing requests.
DELETING: The instance is being deleted.
UNDEFINED: The initial state of the instance, the VM has not been created yet.
A DataSphere node can have one of the following statuses:
HEALTHY: The number of VMs with the
HEALTHYstatus in the node is equal to the minimum number of VMs needed.
UNHEALTHY: The number of VMs with the
HEALTHYstatus in the node is below the allowable minimum.
CREATED: The node has just been created.
DELETING: The node is being deleted.