mindie 推理失败
收藏回复举报
mindie 推理失败
发表于2024-07-13 17:21:42
0 查看
2024-07-14 01:05:13,628 [ERROR] model.py:30 - [Model]   >>> Exception:No module named 'atb_llm' 

Traceback (most recent call last): 

  File "/usr/local/Ascend/mindie/latest/mindie-service/bin/model.py", line 28, in initialize 

    return self.python_model.initialize(config) 

  File "/usr/local/Ascend/mindie/latest/mindie-service/bin/standard_model.py", line 24, in initialize 

    self.model = WrapperFactory.get_model_wrapper(model_config) 

  File "/usr/local/Ascend/mindie/latest/mindie-service/bin/utils/wrapper_factory.py", line 22, in get_model_wrapper 

    from utils.atb_wrapper import StandardATBModelWrapper 

  File "/usr/local/Ascend/mindie/latest/mindie-service/bin/utils/atb_wrapper.py", line 8, in <module> 

    from atb_llm.runner import ModelRunner 

ModuleNotFoundError: No module named 'atb_llm' 

2024-07-14 01:05:13,628 [ERROR] model.py:33 - [Model]   >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'} 

----------------------------------------------------------------

当前python的环境为3.10.0  pip也指向了这个python版本

但是不知道为什么mindie推理一直报错  特别奇怪

本帖最后由 匿名用户2024/07/17 11:21:28 编辑

我要发帖子