Error Codes

Error codes are defined in ${INSTALL_DIR}/include/ge/llm_error_codes.h and ${INSTALL_DIR}/include/llm_datadist/llm_datadist.h. Replace ${INSTALL_DIR} with the CANN component directory. For example, if the installation is performed by the root user, the default file storage path is /usr/local/Ascend/cann.

Error codes are defined by the following macros:

namespace ge {
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_WAIT_PROC_TIMEOUT, 1);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_KV_CACHE_NOT_EXIST, 2);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_REPEAT_REQUEST, 3);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_REQUEST_ALREADY_COMPLETED, 4);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_PARAM_INVALID, 5);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_ENGINE_FINALIZED, 6);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_NOT_YET_LINK, 7);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_ALREADY_LINK, 8);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_LINK_FAILED, 9);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_UNLINK_FAILED, 10);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_NOTIFY_PROMPT_UNLINK_FAILED, 11);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_CLUSTER_NUM_EXCEED_LIMIT, 12);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_PROCESSING_LINK, 13);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_DEVICE_OUT_OF_MEMORY, 14);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_PREFIX_ALREADY_EXIST, 15);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_PREFIX_NOT_EXIST, 16);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_SEQ_LEN_OVER_LIMIT, 17);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_NO_FREE_BLOCK, 18);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_BLOCKS_OUT_OF_MEMORY, 19);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_CACHE_INCOMPATIBLE, 20);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_CACHE_KEY_ALREADY_EXIST, 21);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_COPY_CACHE_FAILED, 22);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_CACHE_ID_ALREADY_EXIST, 23);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_EXIST_LINK, 24);
GE_ERRORNO_DEFINE(0b01, 0b01, 0b000, 8, 11, LLM_FEATURE_NOT_ENABLED, 25);
}  // namespace ge

The meanings of error codes are as follows.

Error Code	Meaning	Possible Cause	Recoverable (Yes/No)	Solution
4294967295	failed!	-	No	Preserve the fault context, collect host/device logs, and back them up. (Device logs must be exported to the host via a port.)
1343270913	request wait to be processed timeout!	Waiting for batch creation times out. Scheduling fails within the timeout period.	Yes	Call complete for processing at the upper layer. Control the loads at the upper layer.
1343270914	KV is not exist!	KVs do not exist when an incremental cluster tries to obtain them from the full cluster.	Yes	Check whether the values of clusterid and req_id are correct. Check if the Prompt side has timed out and verify whether the KV cache has been released. Check whether duplicate pull operations exist.
1343270915	repeat request!	In a single iteration, the same req_id is called for multiple times.	Yes	Check whether repeated calling exists.
1343270916	request already complete!	When scheduled, the upper layer has already sent complete.	Yes	Check whether the complete operation of an unprocessed token is called.
1343270917	Parameter's invalid!	Invalid parameter, including LLM & GE parameter verification. You need to locate the cause based on logs. This fault usually occurs during commissioning.	Yes	Locate the fault based on logs.
1343270918	llm engine finalized!	When scheduled, the upper layer has already sent Finalize.	No	When calling from the upper layer, check whether all requests have been processed before exiting.
1343270919	decoder cluster is no link with prompt!	The Decode side has not established a link with the Prompt side.	Yes	Troubleshoot the link establishment status between the Decode and Prompt sides at the upper layer.
1343270920	decoder cluster is already linked with prompt cluster!	The Decode side has established a link with the Prompt side.	Yes	Troubleshoot the link establishment status between the Decode and Prompt sides at the upper layer.
1343270921	decoder cluster link with prompt cluster failed!	The link between the Decode and Prompt sides fails to be established.	Yes	If the LinkClusters API returns this error code, check the connection establishment result of each cluster in the API output parameters. If the output parameter rets of the LinkClusters API contains this error code, check the network connection between clusters. If the link fails to be established, a rollback is automatically performed to ensure that resources are not abnormally occupied.
1343270922	decoder cluster unlink with prompt cluster failed!	The link between the Decode and Prompt sides fails to be disconnected.	Yes	If the LinkClusters API returns this error code, check the disconnection result of each cluster in the API output parameters. If the output parameter rets of the LinkClusters API contains this error code, check the network connection between clusters. If disconnection fails, rollback is not performed.
1343270923	decoder cluster notify prompt cluster do unlink failed!	The Decode side fails to notify the Prompt side of link disconnection.	Yes	Check the network connectivity between the Decode and Prompt sides. Call the UnlinkClusters API on the Prompt side to clean up residual resources.
1343270924	cluster num exceed limit!	The number of clusters passed at a time to the API exceeds the upper limit. The current upper limit is 16.	Yes	Check the input parameters of the API, and ensure that the number of clusters does not exceed 16.
1343270925	link is current processing, try again later!	The link and unlink operations are being performed.	Yes	Try again later.
1343270926	device out of memory!	The device does not have enough memory for full KV cache operations.	Yes	Pull KV data incrementally until completion, then call LLMReqComplete to terminate the request.
1343270927	Prefix has already existed.	The common prefix already exists.	Yes	Do not deliver requests with the same common prefix repeatedly.
1343270928	Prefix does not exist.	The common prefix does not exist.	Yes	Regenerate the common prefix before delivery.
1343270929	Sequence length exceed limit.	In the PagedAttention scenario, the sentence length exceeds the block space size.	Yes	Check the input parameters of the API. The length of the request sentence cannot exceed block_num x block_size.
1343270930	No free block.	No free block exists in the system.	Yes	The upper layer can choose to recalculate or release existing requests.
1343270931	Block is out of memory.	The pre-allocated blocks memory is insufficient.	Yes	Check whether the total size of the mbuf memory on the data plane is properly configured.

Parent topic: APIs to Be Deprecated