在x86服务器中进行ATC模型转换时提示:E29999: Inner Error, Please contact support engineer!
CANN:Ascend-cann-toolkit_6.3.RC1.alpha001_linux-x86_64.run
python:3.7.5
转换命令:
atc --model=caffe_model/resnet50.prototxt --weight=caffe_model/resnet50.caffemodel --framework=0 --output=model/resnet50 --soc_version=Ascend310 --input_format=NCHW --input_fp16_nodes=data --output_type=FP32 --out_nodes=prob:0
添加log后重定向输出:
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.100.786 [operator_factory_impl.cc:225]57304 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.100.831 [operator_factory_impl.cc:239]57304 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.100.839 [operator_factory_impl.cc:232]57304 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.108.982 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.006 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.013 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.018 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.024 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.029 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.126.690 [compile_cache_policy.cc:63]57304 Create:[CompileCachePolicy] Create CompileCachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.143.172 [process_node_engine_manager.cc:143]57304 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.143.288 [process_node_engine_manager.cc:143]57304 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.153.250 [register.cpp:668]57304 AddAutoMappingSubgraphIOIndexFunc:Regitser auto mapping function: framework type:5.
ATC start working now, please wait for a moment.
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.613 [plugin_manager.cc:525]57304 GetOppSupportedOsAndCpuType:Enter GetOppSupportedOsAndCpuType schedule
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.155.630 [plugin_manager.cc:74]57304 GetOppPath:Enter get opp path schedule
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.155.690 [plugin_manager.cc:83]57304 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.766 [plugin_manager.cc:525]57304 GetOppSupportedOsAndCpuType:Enter GetOppSupportedOsAndCpuType schedule
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.810 [plugin_manager.cc:566]57304 GetOppSupportedOsAndCpuType:Get supported os[linux] -> cpu[x86_64]
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.818 [plugin_manager.cc:566]57304 GetOppSupportedOsAndCpuType:Get supported os[linux] -> cpu[aarch64]
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.828 [plugin_manager.cc:575]57304 GetCurEnvPackageOsAndCpuType:Enter GetCurEnvPackageOsAndCpuType schedule
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.156.105 [plugin_manager.cc:577]57304 GetCurEnvPackageOsAndCpuType:Current lib path is:/usr/local/Ascend/ascend-toolkit/6.3.RC1.alpha001/x86_64-linux/lib64/
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.156.113 [plugin_manager.cc:581]57304 GetCurEnvPackageOsAndCpuType:Run package path is:/usr/local/Ascend/ascend-toolkit/6.3.RC1.alpha001/
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.156.128 [plugin_manager.cc:592]57304 GetCurEnvPackageOsAndCpuType:Begin to extract os and cpu info from /usr/local/Ascend/ascend-toolkit/6.3.RC1.alpha001/opp/scene.info
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.156.214 [plugin_manager.cc:607]57304 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.156.228 [plugin_manager.cc:611]57304 GetCurEnvPackageOsAndCpuType:Get cpu:x86_64
ATC run failed, Please check the detail log, Try 'atc --help' for more information
E29999: Inner Error, Please contact support engineer!
E29999 [GraphOpt][InitializeInner][InitTbeFunc] Failed to init tbe.[FUNC:InitializeInner][FILE:tbe_op_store_adapter.cc][LINE:1532]
TraceBack (most recent call last):
[SubGraphOpt][PreCompileOp][InitAdapter] InitializeAdapter adapter [tbe_op_adapter] failed! Ret [4294967295][FUNC:InitializeAdapter][FILE:op_store_adapter_manager.cc][LINE:67]
[SubGraphOpt][PreCompileOp][Init] Initialize op store adapter failed, OpsStoreName[tbe-custom].[FUNC:Initialize][FILE:op_store_adapter_manager.cc][LINE:115]
[FusionMngr][Init] Op store adapter manager init failed.[FUNC:Initialize][FILE:fusion_manager.cc][LINE:357]
PluginManager InvokeAll failed.[FUNC:Initialize][FILE:ops_kernel_manager.cc][LINE:100]
OpsManager initialize failed.[FUNC:InnerInitialize][FILE:gelib.cc][LINE:185]
GELib::InnerInitialize failed.[FUNC:Initialize][FILE:gelib.cc][LINE:127]
重新开启终端执行命令,仍然报同样的错误。
在x86服务器中进行ATC模型转换时提示:E29999: Inner Error, Please contact support engineer!
CANN:Ascend-cann-toolkit_6.3.RC1.alpha001_linux-x86_64.run
python:3.7.5
转换命令:
atc --model=caffe_model/resnet50.prototxt --weight=caffe_model/resnet50.caffemodel --framework=0 --output=model/resnet50 --soc_version=Ascend310 --input_format=NCHW --input_fp16_nodes=data --output_type=FP32 --out_nodes=prob:0
添加log后重定向输出:
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.100.786 [operator_factory_impl.cc:225]57304 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.100.831 [operator_factory_impl.cc:239]57304 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.100.839 [operator_factory_impl.cc:232]57304 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.108.982 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.006 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.013 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.018 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.024 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.109.029 [ffts_plus_sub_task_factory.cc:48]57304 RegisterCreator:Register creator done.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.126.690 [compile_cache_policy.cc:63]57304 Create:[CompileCachePolicy] Create CompileCachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.143.172 [process_node_engine_manager.cc:143]57304 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.143.288 [process_node_engine_manager.cc:143]57304 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.153.250 [register.cpp:668]57304 AddAutoMappingSubgraphIOIndexFunc:Regitser auto mapping function: framework type:5.
ATC start working now, please wait for a moment.
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.613 [plugin_manager.cc:525]57304 GetOppSupportedOsAndCpuType:Enter GetOppSupportedOsAndCpuType schedule
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.155.630 [plugin_manager.cc:74]57304 GetOppPath:Enter get opp path schedule
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.155.690 [plugin_manager.cc:83]57304 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.766 [plugin_manager.cc:525]57304 GetOppSupportedOsAndCpuType:Enter GetOppSupportedOsAndCpuType schedule
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.810 [plugin_manager.cc:566]57304 GetOppSupportedOsAndCpuType:Get supported os[linux] -> cpu[x86_64]
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.818 [plugin_manager.cc:566]57304 GetOppSupportedOsAndCpuType:Get supported os[linux] -> cpu[aarch64]
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.155.828 [plugin_manager.cc:575]57304 GetCurEnvPackageOsAndCpuType:Enter GetCurEnvPackageOsAndCpuType schedule
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.156.105 [plugin_manager.cc:577]57304 GetCurEnvPackageOsAndCpuType:Current lib path is:/usr/local/Ascend/ascend-toolkit/6.3.RC1.alpha001/x86_64-linux/lib64/
[DEBUG] GE(57304,atc.bin):2024-06-07-02:17:09.156.113 [plugin_manager.cc:581]57304 GetCurEnvPackageOsAndCpuType:Run package path is:/usr/local/Ascend/ascend-toolkit/6.3.RC1.alpha001/
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.156.128 [plugin_manager.cc:592]57304 GetCurEnvPackageOsAndCpuType:Begin to extract os and cpu info from /usr/local/Ascend/ascend-toolkit/6.3.RC1.alpha001/opp/scene.info
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.156.214 [plugin_manager.cc:607]57304 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(57304,atc.bin):2024-06-07-02:17:09.156.228 [plugin_manager.cc:611]57304 GetCurEnvPackageOsAndCpuType:Get cpu:x86_64
ATC run failed, Please check the detail log, Try 'atc --help' for more information
E29999: Inner Error, Please contact support engineer!
E29999 [GraphOpt][InitializeInner][InitTbeFunc] Failed to init tbe.[FUNC:InitializeInner][FILE:tbe_op_store_adapter.cc][LINE:1532]
TraceBack (most recent call last):
[SubGraphOpt][PreCompileOp][InitAdapter] InitializeAdapter adapter [tbe_op_adapter] failed! Ret [4294967295][FUNC:InitializeAdapter][FILE:op_store_adapter_manager.cc][LINE:67]
[SubGraphOpt][PreCompileOp][Init] Initialize op store adapter failed, OpsStoreName[tbe-custom].[FUNC:Initialize][FILE:op_store_adapter_manager.cc][LINE:115]
[FusionMngr][Init] Op store adapter manager init failed.[FUNC:Initialize][FILE:fusion_manager.cc][LINE:357]
PluginManager InvokeAll failed.[FUNC:Initialize][FILE:ops_kernel_manager.cc][LINE:100]
OpsManager initialize failed.[FUNC:InnerInitialize][FILE:gelib.cc][LINE:185]
GELib::InnerInitialize failed.[FUNC:Initialize][FILE:gelib.cc][LINE:127]
重新开启终端执行命令,仍然报同样的错误。