atc --model=yolov5s.onnx --framework=5 --output=yolov5s_bs1 --input_format=NCHW --soc_version=Ascend310B1 --input_fp16_nodes="images"
[EVENT] PROFILING(8914,atc.bin):2023-05-19-15:51:28.626.966 [msprof_callback_impl.cpp:239] >>> (tid:8914) Started to register profiling ctrl callback.
ATC start working now, please wait for a moment.
[EVENT] TBE(9044,python3):2023-05-19-15:51:32.750.644 [../../../../../../latest/python/site-packages/tbe/common/repository_manager/utils/repository_manager_log.py:30][log] [../../../../../../latest/python/site-packages/tbe/common/repository_manager/route.py:273][repository_manager] task_distribute process[9044] running!
....
Failed to compile Op [Concat_110]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/concat_d.py failed with errormsg/stack: ], optype: [ConcatD])
Pre-compile op[Concat_110] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/concat_d.py], optype[ConcatD], taskID[241]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [PartitionedCall_Transpose_262_Transpose_56]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/transpose.py failed with errormsg/stack: ], optype: [Transpose])
Pre-compile op[PartitionedCall_Transpose_262_Transpose_56] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/transpose.py], optype[Transpose], taskID[31]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [trans_Cast_204]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/cast.py failed with errormsg/stack: ], optype: [Cast])
Pre-compile op[trans_Cast_204] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/cast.py], optype[Cast], taskID[32]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Sigmoid_263]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/sigmoid.py failed with errormsg/stack: ], optype: [Sigmoid])
Pre-compile op[Sigmoid_263] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/sigmoid.py], optype[Sigmoid], taskID[34]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Slice_291]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/strided_slice_d.py failed with errormsg/stack: ], optype: [StridedSliceD])
Pre-compile op[Slice_291] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/strided_slice_d.py], optype[StridedSliceD], taskID[35]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Slice_281]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/strided_slice_d.py failed with errormsg/stack: ], optype: [StridedSliceD])
Pre-compile op[Slice_281] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/strided_slice_d.py], optype[StridedSliceD], taskID[39]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Mul_283]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/mul.py failed with errormsg/stack: ], optype: [Mul])
Pre-compile op[Mul_283] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/mul.py], optype[Mul], taskID[41]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Pow_284/Square]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/square.py failed with errormsg/stack: ], optype: [Square])
Pre-compile op[Pow_284/Square] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/square.py], optype[Square], taskID[43]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
...
[SubGraphOpt][Pre-Comp][Node Concat_194] Failed to pre-compile. Tid is [140176170886720], TaskId is [124] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_192] Failed to pre-compile. Tid is [140176170886720], TaskId is [113] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_183] Failed to pre-compile. Tid is [140176170886720], TaskId is [116] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_159] Failed to pre-compile. Tid is [140176170886720], TaskId is [87] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_186] Failed to pre-compile. Tid is [140176170886720], TaskId is [119] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_189] Failed to pre-compile. Tid is [140176170886720], TaskId is [122] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_180] Failed to pre-compile. Tid is [140176170886720], TaskId is [110] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_193] Failed to pre-compile. Tid is [140176170886720], TaskId is [114] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_184] Failed to pre-compile. Tid is [140176170886720], TaskId is [117] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_187] Failed to pre-compile. Tid is [140176170886720], TaskId is [120] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_172] Failed to pre-compile. Tid is [140176170886720], TaskId is [91] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_190] Failed to pre-compile. Tid is [140176170886720], TaskId is [123] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Concat_141] Failed to pre-compile. Tid is [140176170886720], TaskId is [67] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_196] Failed to pre-compile. Tid is [140176170886720], TaskId is [126] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp]Failed to process failed task. Thread_id is [140176170886720].[FUNC:ParallelPreCompileOp][FILE:tbe_op_store_adapter.cc][LINE:501]
[SubGraphOpt][Pre-Comp]Failed to pre-compile graph [partition0_rank5_new_sub_graph136][FUNC:PreCompileOp][FILE:op_compiler.cc][LINE:597]
Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition0_rank5_new_sub_graph136[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131]
build graph failed, graph id:0, ret:-1[FUNC:BuildModel][FILE:ge_generator.cc][LINE:1438]
点赞
收藏
回复
分享
举报
已解决
[EVENT] PROFILING(8914,atc.bin):2023-05-19-15:51:28.626.966 [msprof_callback_impl.cpp:239] >>> (tid:8914) Started to register profiling ctrl callback.
ATC start working now, please wait for a moment.
[EVENT] TBE(9044,python3):2023-05-19-15:51:32.750.644 [../../../../../../latest/python/site-packages/tbe/common/repository_manager/utils/repository_manager_log.py:30][log] [../../../../../../latest/python/site-packages/tbe/common/repository_manager/route.py:273][repository_manager] task_distribute process[9044] running!
....
Failed to compile Op [Concat_110]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/concat_d.py failed with errormsg/stack: ], optype: [ConcatD])
Pre-compile op[Concat_110] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/concat_d.py], optype[ConcatD], taskID[241]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [PartitionedCall_Transpose_262_Transpose_56]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/transpose.py failed with errormsg/stack: ], optype: [Transpose])
Pre-compile op[PartitionedCall_Transpose_262_Transpose_56] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/transpose.py], optype[Transpose], taskID[31]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [trans_Cast_204]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/cast.py failed with errormsg/stack: ], optype: [Cast])
Pre-compile op[trans_Cast_204] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/cast.py], optype[Cast], taskID[32]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Sigmoid_263]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/sigmoid.py failed with errormsg/stack: ], optype: [Sigmoid])
Pre-compile op[Sigmoid_263] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/sigmoid.py], optype[Sigmoid], taskID[34]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Slice_291]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/strided_slice_d.py failed with errormsg/stack: ], optype: [StridedSliceD])
Pre-compile op[Slice_291] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/strided_slice_d.py], optype[StridedSliceD], taskID[35]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Slice_281]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/strided_slice_d.py failed with errormsg/stack: ], optype: [StridedSliceD])
Pre-compile op[Slice_281] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/strided_slice_d.py], optype[StridedSliceD], taskID[39]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Mul_283]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/mul.py failed with errormsg/stack: ], optype: [Mul])
Pre-compile op[Mul_283] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/mul.py], optype[Mul], taskID[41]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
Failed to compile Op [Pow_284/Square]. (oppath: [Pre-compile /usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/square.py failed with errormsg/stack: ], optype: [Square])
Pre-compile op[Pow_284/Square] failed, oppath[/usr/local/Ascend/ascend-toolkit/6.2.RC1/opp/built-in/op_impl/ai_core/tbe/impl/dynamic/square.py], optype[Square], taskID[43]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_op.cc][LINE:858]
...
[SubGraphOpt][Pre-Comp][Node Concat_194] Failed to pre-compile. Tid is [140176170886720], TaskId is [124] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_192] Failed to pre-compile. Tid is [140176170886720], TaskId is [113] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_183] Failed to pre-compile. Tid is [140176170886720], TaskId is [116] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_159] Failed to pre-compile. Tid is [140176170886720], TaskId is [87] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_186] Failed to pre-compile. Tid is [140176170886720], TaskId is [119] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_189] Failed to pre-compile. Tid is [140176170886720], TaskId is [122] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_180] Failed to pre-compile. Tid is [140176170886720], TaskId is [110] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_193] Failed to pre-compile. Tid is [140176170886720], TaskId is [114] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_184] Failed to pre-compile. Tid is [140176170886720], TaskId is [117] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_187] Failed to pre-compile. Tid is [140176170886720], TaskId is [120] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_172] Failed to pre-compile. Tid is [140176170886720], TaskId is [91] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Mul_190] Failed to pre-compile. Tid is [140176170886720], TaskId is [123] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Concat_141] Failed to pre-compile. Tid is [140176170886720], TaskId is [67] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp][Node Sigmoid_196] Failed to pre-compile. Tid is [140176170886720], TaskId is [126] [FUNC:ProcessFailPreCompTask][FILE:tbe_op_store_adapter.cc][LINE:168]
[SubGraphOpt][Pre-Comp]Failed to process failed task. Thread_id is [140176170886720].[FUNC:ParallelPreCompileOp][FILE:tbe_op_store_adapter.cc][LINE:501]
[SubGraphOpt][Pre-Comp]Failed to pre-compile graph [partition0_rank5_new_sub_graph136][FUNC:PreCompileOp][FILE:op_compiler.cc][LINE:597]
Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition0_rank5_new_sub_graph136[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131]
build graph failed, graph id:0, ret:-1[FUNC:BuildModel][FILE:ge_generator.cc][LINE:1438]