Ascend310B,onnx转om转换错误,E40021: Failed to compile Op [input_1_ascend_mbatch_batch_0_0_huawei_aipp,] [EB9999]
收藏回复举报
Ascend310B,onnx转om转换错误,E40021: Failed to compile Op [input_1_ascend_mbatch_batch_0_0_huawei_aipp,] [EB9999]
t('forum.solved') 已解决
新人帖
发表于2024-09-25 12:03:52
0 查看

输入数据为[1,1,-1,-1] UINT8型,其实不是图像,但是模型转换时转换程序强制必须使用data processing,只好选择YUV400,crop、resize、normalize均选择off

2024-09-25 11:46:05  Start to convert model 

2024-09-25 11:46:05  export PATH=$PATH:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/bin && export PYTHONPATH=$PYTHONPATH:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/python/site-packages:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/python/site-packages/schedule_search.egg:/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/op_impl/built-in/ai_core/tbe && export LD_LIBRARY_PATH=/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/lib64:/usr/local/Ascend/driver/lib64:/usr/local/Ascend/driver/lib64/driver:/usr/local/Ascend/ascend-toolkit/7.0.RC1/add-ons:/usr/local/Ascend/ascend-toolkit/7.0.RC1/runtime/lib64:$LD_LIBRARY_PATH:/usr/local/Ascend/ascend-toolkit/7.0.RC1/x86_64-linux/devlib:/usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/devlib:/usr/local/Ascend/ascend-toolkit/7.0.RC1/tools/aoe/lib64:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/lib64/plugin/opskernel && export ASCEND_OPP_PATH=/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp && export ASCEND_SLOG_PRINT_TO_STDOUT=1 && /usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/bin/atc  --input_shape="input_1:1,1,-1,-1;input_2:1,1" --check_report=/root/modelzoo/URD360_Handle/Ascend310B1/network_analysis.report --input_format=NCHW --output="/root/tmp/1727235963594/Ascend310B1/URD360_Handle" --soc_version=Ascend310B1 --dynamic_image_size="4000,448;240,944" --insert_op_conf=/root/modelzoo/URD360_Handle/Ascend310B1/insert_op.cfg --framework=5 --model="/root/tmp/1727234990679/URD360_Handle.onnx"  

2024-09-25 11:46:06  ATC start working now, please wait for a moment. 

2024-09-25 11:47:04  - 

2024-09-25 11:47:14  \ 

2024-09-25 11:47:24  | 

2024-09-25 11:47:36  / 

2024-09-25 11:47:44  - 

2024-09-25 11:47:48  run stack spill compile error:  In file included from <built-in>:1: 

2024-09-25 11:47:48  In file included from /usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/ccec_compiler/lib/clang/15.0.5/include/__clang_cce_runtime_wrapper.h:39: 

2024-09-25 11:47:48  /usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/ccec_compiler/lib/clang/15.0.5/include/__clang_cce_vector_types.h:19:2: warning: The vector size is manually reset. [-W#warnings] 

2024-09-25 11:47:48  #warning The vector size is manually reset. 

2024-09-25 11:47:48   ^ 

2024-09-25 11:47:48  /tmp/tmpu1kzq0ke/my_kernel_core.cce:27:7: error: builtin function type 'void (__cbuf__ unsigned char *, unsigned long, unsigned long) noexcept' of 'load_image_to_cbuf' needs target feature dav-m100|dav-l100-es|dav-t100-es|dav-t100|dav-l100|dav-c100|dav-m200|dav-m201|dav-t200|dav-l200|dav-s200|dav-s200-es|dav-l210|dav-t210|dav-l300|dav-l310 

2024-09-25 11:47:48        load_image_to_cbuf(((__cbuf__ uint8_t *)output_cb), ((uint64_t)((int64_t)4719039 | (((int64_t)(h1 * (uint64_t)73ULL)) << (int64_t)48))), (uint64_t)447ULL); 

2024-09-25 11:47:48        ^ 

2024-09-25 11:47:48  /tmp/tmpu1kzq0ke/my_kernel_core.cce:36:5: error: builtin function type 'void (__cbuf__ unsigned char *, unsigned long, unsigned long) noexcept' of 'load_image_to_cbuf' needs target feature dav-m100|dav-l100-es|dav-t100-es|dav-t100|dav-l100|dav-c100|dav-m200|dav-m201|dav-t200|dav-l200|dav-s200|dav-s200-es|dav-l210|dav-t210|dav-l300|dav-l310 

2024-09-25 11:47:48      load_image_to_cbuf(((__cbuf__ uint8_t *)output_cb), (uint64_t)1109574358197141951ULL, (uint64_t)447ULL); 

2024-09-25 11:47:48      ^ 

2024-09-25 11:47:48  1 warning and 2 errors generated. 

2024-09-25 11:47:52  run stack spill compile error:  In file included from <built-in>:1: 

2024-09-25 11:47:52  In file included from /usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/ccec_compiler/lib/clang/15.0.5/include/__clang_cce_runtime_wrapper.h:39: 

2024-09-25 11:47:52  /usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/ccec_compiler/lib/clang/15.0.5/include/__clang_cce_vector_types.h:19:2: warning: The vector size is manually reset. [-W#warnings] 

2024-09-25 11:47:52  #warning The vector size is manually reset. 

2024-09-25 11:47:52   ^ 

2024-09-25 11:47:52  /tmp/tmpq72hzr_4/my_kernel_core.cce:27:7: error: builtin function type 'void (__cbuf__ unsigned char *, unsigned long, unsigned long) noexcept' of 'load_image_to_cbuf' needs target feature dav-m100|dav-l100-es|dav-t100-es|dav-t100|dav-l100|dav-c100|dav-m200|dav-m201|dav-t200|dav-l200|dav-s200|dav-s200-es|dav-l210|dav-t210|dav-l300|dav-l310 

2024-09-25 11:47:52        load_image_to_cbuf(((__cbuf__ uint8_t *)output_cb), ((uint64_t)((int64_t)2163631 | (((int64_t)(h1 * (uint64_t)34ULL)) << (int64_t)48))), (uint64_t)943ULL); 

2024-09-25 11:47:52        ^ 

2024-09-25 11:47:52  /tmp/tmpq72hzr_4/my_kernel_core.cce:36:5: error: builtin function type 'void (__cbuf__ unsigned char *, unsigned long, unsigned long) noexcept' of 'load_image_to_cbuf' needs target feature dav-m100|dav-l100-es|dav-t100-es|dav-t100|dav-l100|dav-c100|dav-m200|dav-m201|dav-t200|dav-l200|dav-s200|dav-s200-es|dav-l210|dav-t210|dav-l300|dav-l310 

2024-09-25 11:47:52      load_image_to_cbuf(((__cbuf__ uint8_t *)output_cb), (uint64_t)66991044457202607ULL, (uint64_t)943ULL); 

2024-09-25 11:47:52      ^ 

2024-09-25 11:47:52  1 warning and 2 errors generated. 

2024-09-25 11:47:54  \ 

2024-09-25 11:48:04  | 

2024-09-25 11:48:14  / 

2024-09-25 11:48:24  - 

2024-09-25 11:48:34  ... 

2024-09-25 11:48:34  ATC run failed, Please check the detail log, Try 'atc --help' for more information 

2024-09-25 11:48:34  E40021: Failed to compile Op [input_1_ascend_mbatch_batch_0_0_huawei_aipp,]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/aipp.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/7.0.RC1/python/site-packages/tbe/tvm/error_mgr/tbe_python_error_mgr.py", line 112, in raise_tbe_python_err 

2024-09-25 11:48:34      raise TBEPythonError(args_dict) 

2024-09-25 11:48:34  tvm.error_mgr.tbe_python_error_mgr.TBEPythonError: [EB9999] [errClass:N/A][errCode:EB9999][message:compile error In file included from <built-in>:1:In file included from /usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/ccec_compiler/lib/clang/15.0.5/include/__clang_cce_runtime_wrapper.h:39:/usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/ccec_compiler/lib/clang/15.0.5/include/__clang_cce_vector_types.h:19:2: warning: The vector size is manually reset. [-W#warnings]#warning The vector size is manually reset. ^/tmp/tmpu1kzq0ke/my_kernel_core.cce:27:7: error: builtin function type \'void (__cbuf__ unsigned char *, unsigned long, unsigned long) noexcept\' of \'load_image_to_cbuf\' needs target feature dav-m100|dav-l100-es|dav-t100-es|dav-t100|dav-l100|dav-c100|dav-m200|dav-m201|dav-t200|dav-l200|dav-s200|dav-s200-es|dav-l210|dav-t210|dav-l300|dav-l310      load_image_to_cbuf(((__cbuf__ uint8_t *)output_cb), ((uint64_t)((int64_t)4719039 | (((int64_t)(h1 * (uint64_t)73ULL)) << (int64_t)48))), (uint64_t)447ULL);      ^/tmp/tmpu1kzq0ke/my_kernel_core.cce:36:5: error: builtin function type \'void (__cbuf__ unsigned char *, unsigned long, unsigned long) noexcept\' of \'load_image_to_cbuf\' needs target feature dav-m100|dav-l100-es|dav-t100-es|dav-t100|dav-l100|dav-c100|dav-m200|dav-m201|dav-t200|dav-l200|dav-s200|dav-s200-es|dav-l210|dav-t210|dav-l300|dav-l310    load_image_to_cbuf(((__cbuf__ uint8_t *)output_cb), (uint64_t)1109574358197141951ULL, (uint64_t)447ULL);    ^1 warning and 2 errors generated.:][errPcause:N/A][errSolution:N/A]During handling of the above exception, another exception occurred:tvm.error_mgr.tbe_python_error_mgr.TBEPythonError: [errClass:N/A][errCode:EB9999][message:compile cce error : ][errPcause:N/A][errSolution:N/A]', 'errPcause': ' ', 'errSolution': ' '} 

2024-09-25 11:48:34  ], optype: [Aipp]) 

2024-09-25 11:48:34          Solution: See the host log for details, and then check the Python stack where the error log is reported. 

2024-09-25 11:48:34          TraceBack (most recent call last): 

2024-09-25 11:48:34          Compile op[input_1_ascend_mbatch_batch_0_0_huawei_aipp,] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/aipp.py], optype[Aipp], taskID[72]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763] 

2024-09-25 11:48:34          [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083895442720] recompile single op[input_1_ascend_mbatch_batch_0_0_huawei_aipp] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973] 

2024-09-25 11:48:34          [SubGraphOpt][Compile][ParalCompOp] Thread[255083895442720] process fail task failed[FUNC:ParallelCompileOp][FILE:tbe_op_store_adapter.cc][LINE:1019] 

2024-09-25 11:48:34          [SubGraphOpt][Compile][CompOpOnly] CompileOp failed.[FUNC:CompileOpOnly][FILE:op_compiler.cc][LINE:1129] 

2024-09-25 11:48:34          [GraphOpt][FusedGraph][RunCompile] Failed to compile graph with compiler Normal mode Op Compiler[FUNC:SubGraphCompile][FILE:fe_graph_optimizer.cc][LINE:1291] 

2024-09-25 11:48:34          Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition2_rank1_new_sub_graph1[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131] 

2024-09-25 11:48:34          Failed to compile Op [input_1_ascend_mbatch_batch_1_0_huawei_aipp,]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/aipp.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/7.0.RC1/python/site-packages/tbe/tvm/error_mgr/tbe_python_error_mgr.py", line 112, in raise_tbe_python_err 

2024-09-25 11:48:34      raise TBEPythonError(args_dict) 

2024-09-25 11:48:34  tvm.error_mgr.tbe_python_error_mgr.TBEPythonError: [EB9999] [errClass:N/A][errCode:EB9999][message:compile error In file included from <built-in>:1:In file included from /usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/ccec_compiler/lib/clang/15.0.5/include/__clang_cce_runtime_wrapper.h:39:/usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/ccec_compiler/lib/clang/15.0.5/include/__clang_cce_vector_types.h:19:2: warning: The vector size is manually reset. [-W#warnings]#warning The vector size is manually reset. ^/tmp/tmpq72hzr_4/my_kernel_core.cce:27:7: error: builtin function type \'void (__cbuf__ unsigned char *, unsigned long, unsigned long) noexcept\' of \'load_image_to_cbuf\' needs target feature dav-m100|dav-l100-es|dav-t100-es|dav-t100|dav-l100|dav-c100|dav-m200|dav-m201|dav-t200|dav-l200|dav-s200|dav-s200-es|dav-l210|dav-t210|dav-l300|dav-l310      load_image_to_cbuf(((__cbuf__ uint8_t *)output_cb), ((uint64_t)((int64_t)2163631 | (((int64_t)(h1 * (uint64_t)34ULL)) << (int64_t)48))), (uint64_t)943ULL);      ^/tmp/tmpq72hzr_4/my_kernel_core.cce:36:5: error: builtin function type \'void (__cbuf__ unsigned char *, unsigned long, unsigned long) noexcept\' of \'load_image_to_cbuf\' needs target feature dav-m100|dav-l100-es|dav-t100-es|dav-t100|dav-l100|dav-c100|dav-m200|dav-m201|dav-t200|dav-l200|dav-s200|dav-s200-es|dav-l210|dav-t210|dav-l300|dav-l310    load_image_to_cbuf(((__cbuf__ uint8_t *)output_cb), (uint64_t)66991044457202607ULL, (uint64_t)943ULL);    ^1 warning and 2 errors generated.:][errPcause:N/A][errSolution:N/A]During handling of the above exception, another exception occurred:tvm.error_mgr.tbe_python_error_mgr.TBEPythonError: [errClass:N/A][errCode:EB9999][message:compile cce error : ][errPcause:N/A][errSolution:N/A]', 'errPcause': ' ', 'errSolution': ' '} 

2024-09-25 11:48:34  ], optype: [Aipp]) 

2024-09-25 11:48:34          Compile op[input_1_ascend_mbatch_batch_1_0_huawei_aipp,] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/aipp.py], optype[Aipp], taskID[74]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763] 

2024-09-25 11:48:34          [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084189240608] recompile single op[input_1_ascend_mbatch_batch_1_0_huawei_aipp] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973] 

2024-09-25 11:48:34          [SubGraphOpt][Compile][ParalCompOp] Thread[255084189240608] process fail task failed[FUNC:ParallelCompileOp][FILE:tbe_op_store_adapter.cc][LINE:1019] 

2024-09-25 11:48:34          Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition1_rank1_new_sub_graph1[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131] 

2024-09-25 11:48:34          subgraph 3 optimize failed[FUNC:OptimizeSubGraphWithMultiThreads][FILE:graph_manager.cc][LINE:991] 

2024-09-25 11:48:34          build graph failed, graph id:0, ret:-1[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615] 

2024-09-25 11:48:34          GenerateOfflineModel execute failed. 

2024-09-25 11:48:39  Convert model environment variables:  

2024-09-25 11:48:39  export PATH=$PATH:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/bin && export PYTHONPATH=$PYTHONPATH:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/python/site-packages:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/python/site-packages/schedule_search.egg:/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/op_impl/built-in/ai_core/tbe && export LD_LIBRARY_PATH=/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/lib64:/usr/local/Ascend/driver/lib64:/usr/local/Ascend/driver/lib64/driver:/usr/local/Ascend/ascend-toolkit/7.0.RC1/add-ons:/usr/local/Ascend/ascend-toolkit/7.0.RC1/runtime/lib64:$LD_LIBRARY_PATH:/usr/local/Ascend/ascend-toolkit/7.0.RC1/x86_64-linux/devlib:/usr/local/Ascend/ascend-toolkit/7.0.RC1/aarch64-linux/devlib:/usr/local/Ascend/ascend-toolkit/7.0.RC1/tools/aoe/lib64:/usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/lib64/plugin/opskernel && export ASCEND_OPP_PATH=/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp && export ASCEND_SLOG_PRINT_TO_STDOUT=1 

2024-09-25 11:48:39  Convert model command:  

2024-09-25 11:48:39  /usr/local/Ascend/ascend-toolkit/7.0.RC1/compiler/bin/atc  --input_shape="input_1:1,1,-1,-1;input_2:1,1" --check_report=/root/modelzoo/URD360_Handle/Ascend310B1/network_analysis.report --input_format=NCHW --output="/root/tmp/1727235963594/Ascend310B1/URD360_Handle" --soc_version=Ascend310B1 --dynamic_image_size="4000,448;240,944" --insert_op_conf=/root/modelzoo/URD360_Handle/Ascend310B1/insert_op.cfg --framework=5 --model="/root/tmp/1727234990679/URD360_Handle.onnx"  

2024-09-25 11:48:58  Pre-check succeeded 

2024-09-25 11:48:58  Model conversion failure 

2024-09-25 11:48:58  Model input path:/root/tmp/1727234990679/URD360_Handle.onnx 

2024-09-25 11:48:58  Aipp config file path:/root/modelzoo/URD360_Handle/Ascend310B1/insert_op.cfg 

2024-09-25 11:48:58  Model conversion log file path:C:\Users\Administrator\modelzoo\URD360_Handle\Ascend310B1\ModelConvert.txt 

2024-09-25 11:48:59  Model conversion config file path:C:\Users\Administrator\modelzoo\URD360_Handle\Ascend310B1\URD360_Handle_config.json 

2024-09-25 11:48:59  You can quickly reload configurations by choosing Ascend > Model Converter > Load Configuration. 

2024-09-25 11:50:16  (1,1,unk__100,unk__101) converted into (1,1,-1,-1). 

2024-09-25 11:50:16  You can modify the input shapes as required. 

2024-09-25 11:50:34  Successfully finish loaded configuration file. 

我要发帖子