MIE05E010018

Fault Symptom

The MindIE inference request fails. remote_model_instance_id is invalid.

Fault Cause

An inference request is processed in the prefill-decode disaggregation mode. When Generator.pull_kv is called, the connection to the passed remote_model_instance_id has not been established.

Fault Location

Check whether remote_model_instance_id is correct and whether the connection is successfully established.