Triton Model Readiness Check API

Function

Checks the Triton model readiness status.

Format

Operation type: GET

URL: https://{ip}:{port}/v2/models/{MODEL_NAME}/versions/${MODEL_VERSION}/ready

• Preferably set {ip} to POD_IP in Configuration Description. If the environment variable is not configured, set {ip} to the value of manage_ip parameter in the ms_coordinator.json configuration file.
• Preferably set {port} to {status_port} in Starting Coordinator. If the parameter is not configured, set {port} to the value of the status_port parameter in the ms_coordinator.json configuration file.

• The ${MODEL_NAME} field specifies the name of the model to be queried.
• The /versions/${MODEL_VERSION} field is not supported currently and is not passed.

Request Parameters

None

Usage Example

Request example:

GET https://{ip}:{port}/v2/models/llama3-70b/ready

Response example:

No content is available when the Triton model is ready.

Output Description

• Status code 200: The Triton model is ready and the message body is empty.
• Status code 503: The Triton model is not ready and the message body is empty.