输入atc转化报错了，onnx模型链接：https://pan.baidu.com/s/12vh_id3e86cHkpxLZ4VZyA 提取码: 6666
(base) root@davinci-mini:~/huan/project# atc --model=resnet18_imagenet.onnx --framework=5 --output=resnet50 --input_shape="input:1,3,256,256" --soc_version=Ascend310B4
ATC start working now, please wait for a moment.
Exception in thread Thread-1:
Traceback (most recent call last):
File "/usr/local/miniconda3/lib/python3.9/threading.py", line 954, in _bootstrap_inner
self.run()
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/utils/multiprocess_util.py", line 91, in run
key, func, args, kwargs = self.task_q.get(timeout=TIMEOUT)
File "<string>", line 2, in get
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/managers.py", line 809, in _callmethod
kind, result = conn.recv()
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 255, in recv
buf = self._recv_bytes()
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 419, in _recv_bytes
buf = self._recv(4)
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 384, in _recv
chunk = read(handle, remaining)
ConnectionResetError: [Errno 104] Connection reset by peer
Traceback (most recent call last):
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/util.py", line 300, in _run_finalizers
finalizer()
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/util.py", line 224, in __call__
res = self._callback(*self._args, **self._kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 51, in wrapper
return func(cls, *args, **kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 207, in finalize
cls.bank_process_pool.close()
AttributeError: 'NoneType' object has no attribute 'close'
...
ATC run failed, Please check the detail log, Try 'atc --help' for more information
E40021: Failed to compile Op [/layer4/layer4.0/conv2/Conv,[/layer4/layer4.0/conv2/Conv,/layer4/layer4.0/conv2/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 388, in _recv
raise EOFError
EOFError
], optype: [Conv2D])
Solution: See the host log for details, and then check the Python stack where the error log is reported.
TraceBack (most recent call last):
Compile op[/layer4/layer4.0/conv2/Conv,[/layer4/layer4.0/conv2/Conv,/layer4/layer4.0/conv2/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[52]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer2/layer2.0/conv2/Conv,[/layer2/layer2.0/conv2/Conv,/layer2/layer2.0/conv2/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 388, in _recv
raise EOFError
EOFError
], optype: [Conv2D])
Compile op[/layer2/layer2.0/conv2/Conv,[/layer2/layer2.0/conv2/Conv,/layer2/layer2.0/conv2/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[54]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.0/conv2/Conv,[/layer3/layer3.0/conv2/Conv,/layer3/layer3.0/conv2/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 388, in _recv
raise EOFError
EOFError
], optype: [Conv2D])
Compile op[/layer3/layer3.0/conv2/Conv,[/layer3/layer3.0/conv2/Conv,/layer3/layer3.0/conv2/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[53]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
In op [fix_pipe], [fix_pipe does not support single op compilation!]
Failed to compile Op [/layer2/layer2.1/conv2/Convfunction_graph_8//layer2/layer2.1/conv2/Conv_pass.2,[/layer2/layer2.1/relu_1/Relu,/layer2/layer2.1/relu_1/Relu,/layer2/layer2.1/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer2/layer2.1/conv2/Convfunction_graph_8//layer2/layer2.1/conv2/Conv_pass.2,[/layer2/layer2.1/relu_1/Relu,/layer2/layer2.1/relu_1/Relu,/layer2/layer2.1/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[77]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.1/conv1/Convfunction_graph_11//layer3/layer3.1/conv1/Conv_pass.1,[/layer3/layer3.1/relu/Relu,/layer3/layer3.1/relu/Relu]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer3/layer3.1/conv1/Convfunction_graph_11//layer3/layer3.1/conv1/Conv_pass.1,[/layer3/layer3.1/relu/Relu,/layer3/layer3.1/relu/Relu]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[79]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.1/conv2/Convfunction_graph_12//layer3/layer3.1/conv2/Conv_pass.2,[/layer3/layer3.1/relu_1/Relu,/layer3/layer3.1/relu_1/Relu,/layer3/layer3.1/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer3/layer3.1/conv2/Convfunction_graph_12//layer3/layer3.1/conv2/Conv_pass.2,[/layer3/layer3.1/relu_1/Relu,/layer3/layer3.1/relu_1/Relu,/layer3/layer3.1/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[81]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer2/layer2.1/conv1/Convfunction_graph_7//layer2/layer2.1/conv1/Conv_pass.1,[/layer2/layer2.1/relu/Relu,/layer2/layer2.1/relu/Relu]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer2/layer2.1/conv1/Convfunction_graph_7//layer2/layer2.1/conv1/Conv_pass.1,[/layer2/layer2.1/relu/Relu,/layer2/layer2.1/relu/Relu]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[83]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv_pass.1,[/layer4/layer4.0/relu/Relu,/layer4/layer4.0/relu/Relu]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv_pass.1,[/layer4/layer4.0/relu/Relu,/layer4/layer4.0/relu/Relu]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[90]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv_pass.2,[/layer2/layer2.0/relu_1/Relu,/layer2/layer2.0/relu_1/Relu,/layer2/layer2.0/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv_pass.2,[/layer2/layer2.0/relu_1/Relu,/layer2/layer2.0/relu_1/Relu,/layer2/layer2.0/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[86]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv,[/layer2/layer2.0/downsample/downsample.0/Conv,/layer2/layer2.0/downsample/downsample.0/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv,[/layer2/layer2.0/downsample/downsample.0/Conv,/layer2/layer2.0/downsample/downsample.0/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[85]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/conv1/Convfunction_graph_0//conv1/Conv_pass.1,[/relu/Relu,/relu/Relu]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/conv1/Convfunction_graph_0//conv1/Conv_pass.1,[/relu/Relu,/relu/Relu]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[88]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv_pass.2,[/layer1/layer1.0/relu_1/Relu,/layer1/layer1.0/relu_1/Relu,/layer1/layer1.0/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv_pass.2,[/layer1/layer1.0/relu_1/Relu,/layer1/layer1.0/relu_1/Relu,/layer1/layer1.0/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[94]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/conv1/Convfunction_graph_0//conv1/Conv,[/conv1/Conv,/conv1/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/conv1/Convfunction_graph_0//conv1/Conv,[/conv1/Conv,/conv1/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[87]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv,[/layer4/layer4.0/conv1/Conv,/layer4/layer4.0/conv1/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv,[/layer4/layer4.0/conv1/Conv,/layer4/layer4.0/conv1/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[89]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv,[/layer1/layer1.0/conv2/Conv,/layer1/layer1.0/conv2/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv,[/layer1/layer1.0/conv2/Conv,/layer1/layer1.0/conv2/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[93]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv_pass.2,[/layer4/layer4.0/relu_1/Relu,/layer4/layer4.0/relu_1/Relu,/layer4/layer4.0/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv_pass.2,[/layer4/layer4.0/relu_1/Relu,/layer4/layer4.0/relu_1/Relu,/layer4/layer4.0/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[100]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv_pass.2,[/layer3/layer3.0/relu_1/Relu,/layer3/layer3.0/relu_1/Relu,/layer3/layer3.0/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv_pass.2,[/layer3/layer3.0/relu_1/Relu,/layer3/layer3.0/relu_1/Relu,/layer3/layer3.0/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[106]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.1/conv2/Convfunction_graph_16//layer4/layer4.1/conv2/Conv_pass.2,[/layer4/layer4.1/relu_1/Relu,/layer4/layer4.1/relu_1/Relu,/layer4/layer4.1/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer4/layer4.1/conv2/Convfunction_graph_16//layer4/layer4.1/conv2/Conv_pass.2,[/layer4/layer4.1/relu_1/Relu,/layer4/layer4.1/relu_1/Relu,/layer4/layer4.1/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[102]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv,[/layer3/layer3.0/downsample/downsample.0/Conv,/layer3/layer3.0/downsample/downsample.0/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv,[/layer3/layer3.0/downsample/downsample.0/Conv,/layer3/layer3.0/downsample/downsample.0/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[105]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv,[/layer4/layer4.0/downsample/downsample.0/Conv,/layer4/layer4.0/downsample/downsample.0/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv,[/layer4/layer4.0/downsample/downsample.0/Conv,/layer4/layer4.0/downsample/downsample.0/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[99]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.0/conv1/Convfunction_graph_9//layer3/layer3.0/conv1/Conv,[/layer3/layer3.0/conv1/Conv,/layer3/layer3.0/conv1/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer3/layer3.0/conv1/Convfunction_graph_9//layer3/layer3.0/conv1/Conv,[/layer3/layer3.0/conv1/Conv,/layer3/layer3.0/conv1/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[103]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/conv1/Convfunction_graph_9//layer3/layer3.0/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.1/conv2/Convfunction_graph_8//layer2/layer2.1/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.1/conv1/Convfunction_graph_11//layer3/layer3.1/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.1/conv2/Convfunction_graph_12//layer3/layer3.1/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.1/conv1/Convfunction_graph_7//layer2/layer2.1/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.0/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.1/conv1/Convfunction_graph_15//layer4/layer4.1/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.1/conv2/Convfunction_graph_16//layer4/layer4.1/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.1/conv2/Convfunction_graph_8//layer2/layer2.1/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.1/conv1/Convfunction_graph_11//layer3/layer3.1/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/conv1/Convfunction_graph_9//layer3/layer3.0/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.1/conv2/Convfunction_graph_12//layer3/layer3.1/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.1/conv1/Convfunction_graph_7//layer2/layer2.1/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.1/conv1/Convfunction_graph_15//layer4/layer4.1/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/conv1/Convfunction_graph_0//conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer1/layer1.1/conv2/Convfunction_graph_4//layer1/layer1.1/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/conv1/Convfunction_graph_0//conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer1/layer1.1/conv2/Convfunction_graph_4//layer1/layer1.1/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.1/conv2/Convfunction_graph_16//layer4/layer4.1/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ParalCompOp] Thread[255083828333856] process fail task failed[FUNC:ParallelCompileOp][FILE:tbe_op_store_adapter.cc][LINE:1019]
[SubGraphOpt][Compile][CompOpOnly] CompileOp failed.[FUNC:CompileOpOnly][FILE:op_compiler.cc][LINE:1129]
[GraphOpt][FusedGraph][RunCompile] Failed to compile graph with compiler Normal mode Op Compiler[FUNC:SubGraphCompile][FILE:fe_graph_optimizer.cc][LINE:1291]
Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition0_rank1_new_sub_graph1[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131]
subgraph 0 optimize failed[FUNC:OptimizeSubGraphWithMultiThreads][FILE:graph_manager.cc][LINE:991]
build graph failed, graph id:0, ret:-1[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615]
GenerateOfflineModel execute failed.
Compile operator failed, cause: 32Broken pipe File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/interface.py", line 42, in cann_kb_finalize
RouteServer.finalize()
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 51, in wrapper
return func(cls, *args, **kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 212, in finalize
cls.cann_kb_mgr.finalize()
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/cann_kb_manager/knowledge_bank_manager.py", line 41, in finalize
self.__dynamic_mgr.close()
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/cann_kb_manager/base_manager.py", line 325, in close
for name in copy.deepcopy(self.write_kb.keys()):
File "<string>", line 2, in keys
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/managers.py", line 808, in _callmethod
conn.send((self._id, methodname, args, kwds))
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 211, in send
self._send_bytes(_ForkingPickler.dumps(obj))
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 416, in _send_bytes
self._send(header + buf)
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 373, in _send
n = write(self._handle, buf)
点赞
收藏
回复
分享
举报
已解决
输入atc转化报错了，onnx模型链接：https://pan.baidu.com/s/12vh_id3e86cHkpxLZ4VZyA 提取码: 6666
(base) root@davinci-mini:~/huan/project# atc --model=resnet18_imagenet.onnx --framework=5 --output=resnet50 --input_shape="input:1,3,256,256" --soc_version=Ascend310B4
ATC start working now, please wait for a moment.
Exception in thread Thread-1:
Traceback (most recent call last):
File "/usr/local/miniconda3/lib/python3.9/threading.py", line 954, in _bootstrap_inner
self.run()
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/utils/multiprocess_util.py", line 91, in run
key, func, args, kwargs = self.task_q.get(timeout=TIMEOUT)
File "<string>", line 2, in get
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/managers.py", line 809, in _callmethod
kind, result = conn.recv()
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 255, in recv
buf = self._recv_bytes()
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 419, in _recv_bytes
buf = self._recv(4)
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 384, in _recv
chunk = read(handle, remaining)
ConnectionResetError: [Errno 104] Connection reset by peer
Traceback (most recent call last):
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/util.py", line 300, in _run_finalizers
finalizer()
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/util.py", line 224, in __call__
res = self._callback(*self._args, **self._kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 51, in wrapper
return func(cls, *args, **kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 207, in finalize
cls.bank_process_pool.close()
AttributeError: 'NoneType' object has no attribute 'close'
...
ATC run failed, Please check the detail log, Try 'atc --help' for more information
E40021: Failed to compile Op [/layer4/layer4.0/conv2/Conv,[/layer4/layer4.0/conv2/Conv,/layer4/layer4.0/conv2/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 388, in _recv
raise EOFError
EOFError
], optype: [Conv2D])
Solution: See the host log for details, and then check the Python stack where the error log is reported.
TraceBack (most recent call last):
Compile op[/layer4/layer4.0/conv2/Conv,[/layer4/layer4.0/conv2/Conv,/layer4/layer4.0/conv2/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[52]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer2/layer2.0/conv2/Conv,[/layer2/layer2.0/conv2/Conv,/layer2/layer2.0/conv2/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 388, in _recv
raise EOFError
EOFError
], optype: [Conv2D])
Compile op[/layer2/layer2.0/conv2/Conv,[/layer2/layer2.0/conv2/Conv,/layer2/layer2.0/conv2/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[54]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.0/conv2/Conv,[/layer3/layer3.0/conv2/Conv,/layer3/layer3.0/conv2/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 388, in _recv
raise EOFError
EOFError
], optype: [Conv2D])
Compile op[/layer3/layer3.0/conv2/Conv,[/layer3/layer3.0/conv2/Conv,/layer3/layer3.0/conv2/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[53]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
In op [fix_pipe], [fix_pipe does not support single op compilation!]
Failed to compile Op [/layer2/layer2.1/conv2/Convfunction_graph_8//layer2/layer2.1/conv2/Conv_pass.2,[/layer2/layer2.1/relu_1/Relu,/layer2/layer2.1/relu_1/Relu,/layer2/layer2.1/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer2/layer2.1/conv2/Convfunction_graph_8//layer2/layer2.1/conv2/Conv_pass.2,[/layer2/layer2.1/relu_1/Relu,/layer2/layer2.1/relu_1/Relu,/layer2/layer2.1/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[77]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.1/conv1/Convfunction_graph_11//layer3/layer3.1/conv1/Conv_pass.1,[/layer3/layer3.1/relu/Relu,/layer3/layer3.1/relu/Relu]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer3/layer3.1/conv1/Convfunction_graph_11//layer3/layer3.1/conv1/Conv_pass.1,[/layer3/layer3.1/relu/Relu,/layer3/layer3.1/relu/Relu]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[79]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.1/conv2/Convfunction_graph_12//layer3/layer3.1/conv2/Conv_pass.2,[/layer3/layer3.1/relu_1/Relu,/layer3/layer3.1/relu_1/Relu,/layer3/layer3.1/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer3/layer3.1/conv2/Convfunction_graph_12//layer3/layer3.1/conv2/Conv_pass.2,[/layer3/layer3.1/relu_1/Relu,/layer3/layer3.1/relu_1/Relu,/layer3/layer3.1/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[81]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer2/layer2.1/conv1/Convfunction_graph_7//layer2/layer2.1/conv1/Conv_pass.1,[/layer2/layer2.1/relu/Relu,/layer2/layer2.1/relu/Relu]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer2/layer2.1/conv1/Convfunction_graph_7//layer2/layer2.1/conv1/Conv_pass.1,[/layer2/layer2.1/relu/Relu,/layer2/layer2.1/relu/Relu]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[83]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv_pass.1,[/layer4/layer4.0/relu/Relu,/layer4/layer4.0/relu/Relu]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv_pass.1,[/layer4/layer4.0/relu/Relu,/layer4/layer4.0/relu/Relu]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[90]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv_pass.2,[/layer2/layer2.0/relu_1/Relu,/layer2/layer2.0/relu_1/Relu,/layer2/layer2.0/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv_pass.2,[/layer2/layer2.0/relu_1/Relu,/layer2/layer2.0/relu_1/Relu,/layer2/layer2.0/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[86]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv,[/layer2/layer2.0/downsample/downsample.0/Conv,/layer2/layer2.0/downsample/downsample.0/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv,[/layer2/layer2.0/downsample/downsample.0/Conv,/layer2/layer2.0/downsample/downsample.0/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[85]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/conv1/Convfunction_graph_0//conv1/Conv_pass.1,[/relu/Relu,/relu/Relu]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/conv1/Convfunction_graph_0//conv1/Conv_pass.1,[/relu/Relu,/relu/Relu]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[88]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv_pass.2,[/layer1/layer1.0/relu_1/Relu,/layer1/layer1.0/relu_1/Relu,/layer1/layer1.0/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv_pass.2,[/layer1/layer1.0/relu_1/Relu,/layer1/layer1.0/relu_1/Relu,/layer1/layer1.0/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[94]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/conv1/Convfunction_graph_0//conv1/Conv,[/conv1/Conv,/conv1/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/conv1/Convfunction_graph_0//conv1/Conv,[/conv1/Conv,/conv1/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[87]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv,[/layer4/layer4.0/conv1/Conv,/layer4/layer4.0/conv1/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv,[/layer4/layer4.0/conv1/Conv,/layer4/layer4.0/conv1/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[89]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv,[/layer1/layer1.0/conv2/Conv,/layer1/layer1.0/conv2/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv,[/layer1/layer1.0/conv2/Conv,/layer1/layer1.0/conv2/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[93]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv_pass.2,[/layer4/layer4.0/relu_1/Relu,/layer4/layer4.0/relu_1/Relu,/layer4/layer4.0/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv_pass.2,[/layer4/layer4.0/relu_1/Relu,/layer4/layer4.0/relu_1/Relu,/layer4/layer4.0/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[100]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv_pass.2,[/layer3/layer3.0/relu_1/Relu,/layer3/layer3.0/relu_1/Relu,/layer3/layer3.0/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv_pass.2,[/layer3/layer3.0/relu_1/Relu,/layer3/layer3.0/relu_1/Relu,/layer3/layer3.0/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[106]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.1/conv2/Convfunction_graph_16//layer4/layer4.1/conv2/Conv_pass.2,[/layer4/layer4.1/relu_1/Relu,/layer4/layer4.1/relu_1/Relu,/layer4/layer4.1/Add]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/utils/errormgr/error_manager_vector.py", line 284, in raise_err_specific_reson
raise RuntimeError(args_dict, msg)
RuntimeError: ({'errCode': 'E61001', 'op_name': 'fix_pipe', 'reason': 'fix_pipe does not support single op compilation!'}, 'In op [fix_pipe], [fix_pipe does not support single op compilation!]')
], optype: [FixPipe])
Compile op[/layer4/layer4.1/conv2/Convfunction_graph_16//layer4/layer4.1/conv2/Conv_pass.2,[/layer4/layer4.1/relu_1/Relu,/layer4/layer4.1/relu_1/Relu,/layer4/layer4.1/Add]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/fix_pipe.py], optype[FixPipe], taskID[102]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv,[/layer3/layer3.0/downsample/downsample.0/Conv,/layer3/layer3.0/downsample/downsample.0/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv,[/layer3/layer3.0/downsample/downsample.0/Conv,/layer3/layer3.0/downsample/downsample.0/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[105]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv,[/layer4/layer4.0/downsample/downsample.0/Conv,/layer4/layer4.0/downsample/downsample.0/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv,[/layer4/layer4.0/downsample/downsample.0/Conv,/layer4/layer4.0/downsample/downsample.0/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[99]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
Failed to compile Op [/layer3/layer3.0/conv1/Convfunction_graph_9//layer3/layer3.0/conv1/Conv,[/layer3/layer3.0/conv1/Conv,/layer3/layer3.0/conv1/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
Compile op[/layer3/layer3.0/conv1/Convfunction_graph_9//layer3/layer3.0/conv1/Conv,[/layer3/layer3.0/conv1/Conv,/layer3/layer3.0/conv1/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.RC1/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[103]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/conv1/Convfunction_graph_9//layer3/layer3.0/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.1/conv2/Convfunction_graph_8//layer2/layer2.1/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.1/conv1/Convfunction_graph_11//layer3/layer3.1/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.1/conv2/Convfunction_graph_12//layer3/layer3.1/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.1/conv1/Convfunction_graph_7//layer2/layer2.1/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.0/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.1/conv1/Convfunction_graph_15//layer4/layer4.1/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.1/conv2/Convfunction_graph_16//layer4/layer4.1/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.1/conv2/Convfunction_graph_8//layer2/layer2.1/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/downsample/downsample.0/Convfunction_graph_10//layer3/layer3.0/downsample/downsample.0/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.1/conv1/Convfunction_graph_11//layer3/layer3.1/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.0/conv1/Convfunction_graph_9//layer3/layer3.0/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer3/layer3.1/conv2/Convfunction_graph_12//layer3/layer3.1/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.1/conv1/Convfunction_graph_7//layer2/layer2.1/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.1/conv1/Convfunction_graph_15//layer4/layer4.1/conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer2/layer2.0/downsample/downsample.0/Convfunction_graph_6//layer2/layer2.0/downsample/downsample.0/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/conv1/Convfunction_graph_0//conv1/Conv_pass.1] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer1/layer1.1/conv2/Convfunction_graph_4//layer1/layer1.1/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/conv1/Convfunction_graph_0//conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/conv1/Convfunction_graph_13//layer4/layer4.0/conv1/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer1/layer1.0/conv2/Convfunction_graph_2//layer1/layer1.0/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer1/layer1.1/conv2/Convfunction_graph_4//layer1/layer1.1/conv2/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.0/downsample/downsample.0/Convfunction_graph_14//layer4/layer4.0/downsample/downsample.0/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[255083828333856] recompile single op[/layer4/layer4.1/conv2/Convfunction_graph_16//layer4/layer4.1/conv2/Conv_pass.2] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:973]
[SubGraphOpt][Compile][ParalCompOp] Thread[255083828333856] process fail task failed[FUNC:ParallelCompileOp][FILE:tbe_op_store_adapter.cc][LINE:1019]
[SubGraphOpt][Compile][CompOpOnly] CompileOp failed.[FUNC:CompileOpOnly][FILE:op_compiler.cc][LINE:1129]
[GraphOpt][FusedGraph][RunCompile] Failed to compile graph with compiler Normal mode Op Compiler[FUNC:SubGraphCompile][FILE:fe_graph_optimizer.cc][LINE:1291]
Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition0_rank1_new_sub_graph1[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131]
subgraph 0 optimize failed[FUNC:OptimizeSubGraphWithMultiThreads][FILE:graph_manager.cc][LINE:991]
build graph failed, graph id:0, ret:-1[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615]
GenerateOfflineModel execute failed.
Compile operator failed, cause: 32Broken pipe File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/interface.py", line 42, in cann_kb_finalize
RouteServer.finalize()
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 51, in wrapper
return func(cls, *args, **kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 212, in finalize
cls.cann_kb_mgr.finalize()
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/cann_kb_manager/knowledge_bank_manager.py", line 41, in finalize
self.__dynamic_mgr.close()
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/cann_kb_manager/base_manager.py", line 325, in close
for name in copy.deepcopy(self.write_kb.keys()):
File "<string>", line 2, in keys
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/managers.py", line 808, in _callmethod
conn.send((self._id, methodname, args, kwds))
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 211, in send
self._send_bytes(_ForkingPickler.dumps(obj))
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 416, in _send_bytes
self._send(header + buf)
File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 373, in _send
n = write(self._handle, buf)