部署ChatGLM2-6B模型出错
收藏回复举报
部署ChatGLM2-6B模型出错
发表于2024-03-07 09:09:53
0 查看

运行官方提供的推理命令时报错

(chatglm) [root@pj03 shaohongming]# python infer.py  

Traceback (most recent call last): 

  File "/data/apps/tools/miniconda3/envs/chatglm/lib/python3.7/site-packages/torch_npu/__init__.py", line 32, in <module> 

    import torch_npu.npu 

  File "/data/apps/tools/miniconda3/envs/chatglm/lib/python3.7/site-packages/torch_npu/npu/__init__.py", line 46, in <module> 

    from .utils import (is_initialized, _lazy_call, _lazy_init, init, set_dump, 

  File "/data/apps/tools/miniconda3/envs/chatglm/lib/python3.7/site-packages/torch_npu/npu/utils.py", line 28, in <module> 

    import torch_npu._C 

ImportError: /data/apps/tools/miniconda3/envs/chatglm/lib/python3.7/site-packages/torch_npu/lib/libtorch_npu.so: undefined symbol: _ZN2at18TensorIteratorBase10set_outputElN3c108ArrayRefIlEES3_NS1_13TensorOptionsENS2_INS_7DimnameEEE 

段错误 (核心已转储) 

是版本不匹配的原因吗,cann版本为6.0.1

本帖最后由 匿名用户2024/03/07 10:41:10 编辑

我要发帖子