镜像版本:mindie:1.0.RC3-300I-Duo-arm64
驱动版本:24.1.rc2
执行./mindieservice_daemon
310的镜像为什么调用910相关的内容 SelfAttentionEncoderFusionOpsRunner910A_2_0_3
报错信息如下:
2024-12-23 08:32:10,664 [ERROR] model.py:42 - [Model] >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}
2024-12-23 08:32:10,664 [ERROR] model.py:42 - [Model] >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}
[2024-12-23 08:32:10.681579] [error] [9887] [unpad_flash_attention_nz_operation.cpp:235] current mask shape is unsupported!
[2024-12-23 08:32:10.681628] [error] [9887] [unpad_flash_attention_nz_operation.cpp:363] mask invalid
[2024-12-23 08:32:10.681636] [error] [9887] [unpad_flash_attention_nz_operation.cpp:94] Failed to check run info
[2024-12-23 08:32:10.681643] [error] [9887] [mki_node_implement.cpp:117] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 node[3] UnpadFlashAttentionNzOperation mki node infer shape fail, error:Failed to check run info
[2024-12-23 08:32:10.681651] [error] [9887] [ops_runner.cpp:712] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 node[3] plan kernel inferShape fail
[2024-12-23 08:32:10.681659] [error] [9887] [ops_runner.cpp:663] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 node[3] plan kernel graph fail
[2024-12-23 08:32:10.681664] [error] [9887] [ops_runner.cpp:217] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 PlanKernelGraph fail
[2024-12-23 08:32:10.681671] [error] [9887] [graph_runner.cpp:743] AttentionRunner_2_0:0 node[3] setup fail, error code:3
[2024-12-23 08:32:10.681678] [error] [9887] [graph_runner.cpp:289] AttentionRunner_2_0:0 node[3] SetupNodeRunners fail, error code:3
[2024-12-23 08:32:10.681686] [error] [9887] [graph_runner.cpp:743] Prefill_layerRunner_2:0 node[0] setup fail, error code:3
[2024-12-23 08:32:10.681691] [error] [9887] [graph_runner.cpp:289] Prefill_layerRunner_2:0 node[0] SetupNodeRunners fail, error code:3
[2024-12-23 08:32:10.681697] [error] [9887] [operation_base.cpp:453] Prefill_layer_2 runner setup fail
[2024-12-23 08:32:10.681703] [error] [9887] [operation_base.cpp:509] Prefill_layer_2 setup fail, error code: 3
2024-12-23 08:32:10,682 [ERROR] model.py:39 - [Model] >>> Exception:Setup fail, enable log: export ASDOPS_LOG_LEVEL=ERROR, export ASDOPS_LOG_TO_STDOUT=1 to find the first error. For more details, see the MindIE official document.
Traceback (most recent call last):
File "/usr/local/python3.11.10/lib/python3.11/site-packages/model_wrapper/model.py", line 37, in initialize
return self.python_model.initialize(config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/python3.11.10/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 144, in initialize
self.generator = Generator(
^^^^^^^^^^
File "/usr/local/python3.11.10/lib/python3.11/site-packages/min
镜像版本:mindie:1.0.RC3-300I-Duo-arm64
驱动版本:24.1.rc2
执行./mindieservice_daemon
310的镜像为什么调用910相关的内容 SelfAttentionEncoderFusionOpsRunner910A_2_0_3
报错信息如下:
2024-12-23 08:32:10,664 [ERROR] model.py:42 - [Model] >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}
2024-12-23 08:32:10,664 [ERROR] model.py:42 - [Model] >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}
[2024-12-23 08:32:10.681579] [error] [9887] [unpad_flash_attention_nz_operation.cpp:235] current mask shape is unsupported!
[2024-12-23 08:32:10.681628] [error] [9887] [unpad_flash_attention_nz_operation.cpp:363] mask invalid
[2024-12-23 08:32:10.681636] [error] [9887] [unpad_flash_attention_nz_operation.cpp:94] Failed to check run info
[2024-12-23 08:32:10.681643] [error] [9887] [mki_node_implement.cpp:117] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 node[3] UnpadFlashAttentionNzOperation mki node infer shape fail, error:Failed to check run info
[2024-12-23 08:32:10.681651] [error] [9887] [ops_runner.cpp:712] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 node[3] plan kernel inferShape fail
[2024-12-23 08:32:10.681659] [error] [9887] [ops_runner.cpp:663] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 node[3] plan kernel graph fail
[2024-12-23 08:32:10.681664] [error] [9887] [ops_runner.cpp:217] SelfAttentionEncoderFusionOpsRunner910A_2_0_3:0 PlanKernelGraph fail
[2024-12-23 08:32:10.681671] [error] [9887] [graph_runner.cpp:743] AttentionRunner_2_0:0 node[3] setup fail, error code:3
[2024-12-23 08:32:10.681678] [error] [9887] [graph_runner.cpp:289] AttentionRunner_2_0:0 node[3] SetupNodeRunners fail, error code:3
[2024-12-23 08:32:10.681686] [error] [9887] [graph_runner.cpp:743] Prefill_layerRunner_2:0 node[0] setup fail, error code:3
[2024-12-23 08:32:10.681691] [error] [9887] [graph_runner.cpp:289] Prefill_layerRunner_2:0 node[0] SetupNodeRunners fail, error code:3
[2024-12-23 08:32:10.681697] [error] [9887] [operation_base.cpp:453] Prefill_layer_2 runner setup fail
[2024-12-23 08:32:10.681703] [error] [9887] [operation_base.cpp:509] Prefill_layer_2 setup fail, error code: 3
2024-12-23 08:32:10,682 [ERROR] model.py:39 - [Model] >>> Exception:Setup fail, enable log: export ASDOPS_LOG_LEVEL=ERROR, export ASDOPS_LOG_TO_STDOUT=1 to find the first error. For more details, see the MindIE official document.
Traceback (most recent call last):
File "/usr/local/python3.11.10/lib/python3.11/site-packages/model_wrapper/model.py", line 37, in initialize
return self.python_model.initialize(config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/python3.11.10/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 144, in initialize
self.generator = Generator(
^^^^^^^^^^
File "/usr/local/python3.11.10/lib/python3.11/site-packages/min