震惊,MIndIE镜像版mindie:1.0.RC3-300I-Duo-arm64 本推理VL模型存在严重BUG
收藏回复举报
震惊,MIndIE镜像版mindie:1.0.RC3-300I-Duo-arm64 本推理VL模型存在严重BUG
t('forum.solved') 已解决
发表于2024-12-23 16:38:50
0 查看

镜像版本:mindie:1.0.RC3-300I-Duo-arm64

驱动版本:24.1.rc2 

执行./mindieservice_daemon

310的镜像为什么调用910相关的内容 SelfAttentionEncoderFusionOpsRunner910A_2_0_3

报错信息如下:

2024-12-23 08:32:10,664 [ERROR] model.py:42 - [Model]   >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'} 

2024-12-23 08:32:10,664 [ERROR] model.py:42 - [Model]   >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'} 

[2024-12-23 08:32:10.681579] [error] [9887] [unpad_flash_attention_nz_operation.cpp:235] current mask shape is unsupported! 

[2024-12-23 08:32:10.681628] [error] [9887] [unpad_flash_attention_nz_operation.cpp:363] mask invalid 

[2024-12-23 08:32:10.681636] [error] [9887] [unpad_flash_attention_nz_operation.cpp:94] Failed to check run info 

[2024-12-23 08:32:10.681643] [error] [9887] [mki_node_implement.cpp:117] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0  node[3] UnpadFlashAttentionNzOperation mki node infer shape fail, error:Failed to check run info 

[2024-12-23 08:32:10.681651] [error] [9887] [ops_runner.cpp:712] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0  node[3] plan kernel inferShape fail 

[2024-12-23 08:32:10.681659] [error] [9887] [ops_runner.cpp:663] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0  node[3] plan kernel graph fail 

[2024-12-23 08:32:10.681664] [error] [9887] [ops_runner.cpp:217] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 PlanKernelGraph fail 

[2024-12-23 08:32:10.681671] [error] [9887] [graph_runner.cpp:743] AttentionRunner_2_0:0  node[3] setup fail, error code:3 

[2024-12-23 08:32:10.681678] [error] [9887] [graph_runner.cpp:289] AttentionRunner_2_0:0 node[3] SetupNodeRunners fail, error code:3 

[2024-12-23 08:32:10.681686] [error] [9887] [graph_runner.cpp:743] Prefill_layerRunner_2:0  node[0] setup fail, error code:3 

[2024-12-23 08:32:10.681691] [error] [9887] [graph_runner.cpp:289] Prefill_layerRunner_2:0 node[0] SetupNodeRunners fail, error code:3 

[2024-12-23 08:32:10.681697] [error] [9887] [operation_base.cpp:453] Prefill_layer_2 runner setup fail 

[2024-12-23 08:32:10.681703] [error] [9887] [operation_base.cpp:509] Prefill_layer_2 setup fail, error code: 3 

2024-12-23 08:32:10,682 [ERROR] model.py:39 - [Model]   >>> Exception:Setup fail, enable log: export ASDOPS_LOG_LEVEL=ERROR, export ASDOPS_LOG_TO_STDOUT=1 to find the first error. For more details, see the MindIE official document.  

Traceback (most recent call last): 

  File "/usr/local/python3.11.10/lib/python3.11/site-packages/model_wrapper/model.py", line 37, in initialize 

    return self.python_model.initialize(config) 

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/python3.11.10/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 144, in initialize 

    self.generator = Generator( 

                     ^^^^^^^^^^ 

  File "/usr/local/python3.11.10/lib/python3.11/site-packages/min

我要发帖子