Error Code Display Mode

The error code of MindIE LLM has six digits, in decimal format. The following uses 000002 as an example. For details about the fields, see Table 1.

Table 1 Field description

Error Code Field

Description

00 (first two digits)

Subcomponent code. The options are:

  • 00: ATB_MODELS
  • 01: TEXT_GENERATOR
  • 03: BACKEND
  • 04: LLM_MANAGER

00 (two digits in the middle)

Feature ID.

02 (last two digits)

Error type. The options are:

  • ATB_MODELS
    • 00: Initialization failure: model parameters fail to be verified.
    • 01: Initialization failure: fails to verify the parameters in JSON format of the model graph.
    • 02: Model runtime: fails to execute the framework.
  • TEXT_GENERATOR
    • 00: Initialization failure: plugin feature not supported.
    • 01: Initialization failure: requirements on feature usage not met.
    • 02: Inference request failure: invalid request_ids.
    • 05: Inference request failure: inference process exception, which triggers division-by-zero protection.
    • 06: Inference request failure: inference process exception.
    • 07: Inference request failure: invalid request_ids.
    • 08: Initialization failure: generator_backend type not supported.
    • 09: Inference request failure: shape of request_ids fails to be verified.
    • 10: Inference request failure: no parameter cache in the decode phase.
    • 11: Inference request failure: block_size verification fails.
    • 12: Initialization failure: invalid eos_token_id.
    • 16: Inference request failure: An unknown error occurs in LLM-DataDist.
    • 17: Inference request failure: invalid block ID.
    • 18: Inference request failure: invalid remote_model_instance_id.
    • 19: Inference request failure: link or pull_kv failure during prefill-decode disaggregation.
    • 1A: Inference request failure: A new connection is set up for a device that has been connected.
    • 1B: Inference request failure: link timeout.
  • BACKEND
    • 00: Fails to verify ModelDeployConfig.
    • 01: Fails to initialize LLMManager.
  • LLM_MANAGER
    • 00: Fails to verify BackendConfig.
    • 01: Fails to initialize LLMInferModels.