您好,我在使用CANN7.0RC1对模型(经过量化后的Llama3.1onnx模型)进行转换时,报错信息如下:
ATC run failed, Please check the detail log, Try 'atc --help' for more information E10042: GenerateOfflineModel execute failed.
TraceBack (most recent call last):
build graph failed, graph id:0, ret:1343225857[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615]
GenerateOfflineModel execute failed.
其中,模型转换指令为:
atc --framework=5 --model="llama3.onnx" --output="llama3.om" --input_format=ND --input_shape="input_ids:1,1;attention_mask:1,1025;position_ids:1,1;past_key_values:32,2,1,32,1024,128" --log=debug --soc_version=Ascend310B1 --precision_mode=must_keep_origin_dtype
麻烦帮忙看一下,非常感谢!
ATC run failed, Please check the detail log, Try 'atc --help' for more information
E10042: GenerateOfflineModel execute failed.
TraceBack (most recent call last):
build graph failed, graph id:0, ret:1343225857[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615]
GenerateOfflineModel execute failed.
其中,模型转换指令为:atc --framework=5 --model="llama3.onnx" --output="llama3.om" --input_format=ND --input_shape="input_ids:1,1;attention_mask:1,1025;position_ids:1,1;past_key_values:32,2,1,32,1024,128" --log=debug --soc_version=Ascend310B1 --precision_mode=must_keep_origin_dtype
麻烦帮忙看一下,非常感谢!