您好，我在使用CANN7.0RC1对模型（经过量化后的Llama3.1onnx模型）进行转换时，报错信息如下：
E19010: No parser is registered for Op [/model/layers.0/self_attn/q_proj/MatMulInteger, optype [ai.onnx::17::MatMulInteger]]. Solution: Check the version of the installation package and reinstall the package. For details, see the operator specifications.
TraceBack (most recent call last):
No parser is registered for Op [/model/layers.0/self_attn/k_proj/MatMulInteger, optype [ai.onnx::17::MatMulInteger]].
No parser is registered for Op [/model/layers.0/self_attn/v_proj/MatMulInteger, optype [ai.onnx::17::MatMulInteger]].
其中，模型转换指令为：
atc --framework=5 --model="llama3.onnx" --output="llama3.om" --input_format=ND --input_shape="input_ids:1,1;attention_mask:1,1025;position_ids:1,1;past_key_values:32,2,1,32,1024,128" --log=debug --soc_version=Ascend310B1 --precision_mode=must_keep_origin_dtype
点赞
收藏
回复
分享
举报
已解决
E19010: No parser is registered for Op [/model/layers.0/self_attn/q_proj/MatMulInteger, optype [ai.onnx::17::MatMulInteger]].
Solution: Check the version of the installation package and reinstall the package. For details, see the operator specifications.
TraceBack (most recent call last):
No parser is registered for Op [/model/layers.0/self_attn/k_proj/MatMulInteger, optype [ai.onnx::17::MatMulInteger]].
No parser is registered for Op [/model/layers.0/self_attn/v_proj/MatMulInteger, optype [ai.onnx::17::MatMulInteger]].
其中，模型转换指令为：atc --framework=5 --model="llama3.onnx" --output="llama3.om" --input_format=ND --input_shape="input_ids:1,1;attention_mask:1,1025;position_ids:1,1;past_key_values:32,2,1,32,1024,128" --log=debug --soc_version=Ascend310B1 --precision_mode=must_keep_origin_dtype