一、环境
二、问题
参照官网将pytorch进行迁移时，训练错误、感觉底层算子不支持反向想来确认一下推理卡能不能进行训练pytorch 的模型
参考链接：快速体验-PyTorch 网络模型迁移和训练-训练开发（PyTorch）-...-文档首页-昇腾社区 (hiascend.com)
反向传播时 loss.backward()出现以下错误,求解决
Traceback (most recent call last):
File "/home/guoxiao/models/official/cv/YOLOv5/LeNet_Pytorch2NPU.py", line 73, in
scaler.scale(loss).backward()# 损失函数反向计算
File "/home/envs/torch/lib/python3.9/site-packages/torch/_tensor.py", line 492, in backward
torch.autograd.backward(
File "/home/envs/torch/lib/python3.9/site-packages/torch/autograd/__init__.py", line 251, in backward
Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass
RuntimeError: InnerRun:torch_npu/csrc/framework/OpParamMaker.cpp:208 NPU error, error code is 500002
[Error]: A GE error occurs in the system.
Rectify the fault based on the error information in the ascend log.
EZ3003: No supported Ops kernel and engine are found for [MaxPoolGradWithArgmaxV130], optype [MaxPoolGradWithArgmaxV1].
Possible Cause: The operator is not supported by the system. Therefore, no hit is found in any operator information library.
Solution: 1. Check that the OPP component is installed properly. 2. Submit an issue to request for the support of this operator type.
TraceBack (most recent call last):
build graph failed, graph id:29, ret:-1[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615]
[Build][SingleOpModel]call ge interface generator.BuildSingleOpModel failed. ge result = 4294967295[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161]
[Build][Op]Fail to build op model[FUNC:ReportInnerError][FILE:log_inn
反向传播时 loss.backward()出现以下错误
RuntimeError: InnerRun:torch_npu/csrc/framework/OpParamMaker.cpp:208 NPU error, error code is 500002
[Error]: A GE error occurs in the system.
Rectify the fault based on the error information in the ascend log.
EZ3003: No supported Ops kernel and engine are found for [MaxPoolGradWithArgmaxV130], optype [MaxPoolGradWithArgmaxV1].
Possible Cause: The operator is not supported by the system. Therefore, no hit is found in any operator information library.
点赞
收藏
回复
分享
举报
一、环境
二、问题
参照官网将pytorch进行迁移时，训练错误、感觉底层算子不支持反向想来确认一下推理卡能不能进行训练pytorch 的模型
参考链接：快速体验-PyTorch 网络模型迁移和训练-训练开发（PyTorch）-...-文档首页-昇腾社区 (hiascend.com)
反向传播时 loss.backward()出现以下错误,求解决
Traceback (most recent call last):
File "/home/guoxiao/models/official/cv/YOLOv5/LeNet_Pytorch2NPU.py", line 73, in
scaler.scale(loss).backward()# 损失函数反向计算
File "/home/envs/torch/lib/python3.9/site-packages/torch/_tensor.py", line 492, in backward
torch.autograd.backward(
File "/home/envs/torch/lib/python3.9/site-packages/torch/autograd/__init__.py", line 251, in backward
Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass
RuntimeError: InnerRun:torch_npu/csrc/framework/OpParamMaker.cpp:208 NPU error, error code is 500002
[Error]: A GE error occurs in the system.
Rectify the fault based on the error information in the ascend log.
EZ3003: No supported Ops kernel and engine are found for [MaxPoolGradWithArgmaxV130], optype [MaxPoolGradWithArgmaxV1].
Possible Cause: The operator is not supported by the system. Therefore, no hit is found in any operator information library.
Solution: 1. Check that the OPP component is installed properly. 2. Submit an issue to request for the support of this operator type.
TraceBack (most recent call last):
build graph failed, graph id:29, ret:-1[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615]
[Build][SingleOpModel]call ge interface generator.BuildSingleOpModel failed. ge result = 4294967295[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161]
[Build][Op]Fail to build op model[FUNC:ReportInnerError][FILE:log_inn
反向传播时 loss.backward()出现以下错误
RuntimeError: InnerRun:torch_npu/csrc/framework/OpParamMaker.cpp:208 NPU error, error code is 500002
[Error]: A GE error occurs in the system.
Rectify the fault based on the error information in the ascend log.
EZ3003: No supported Ops kernel and engine are found for [MaxPoolGradWithArgmaxV130], optype [MaxPoolGradWithArgmaxV1].
Possible Cause: The operator is not supported by the system. Therefore, no hit is found in any operator information library.