2024-07-14 01:05:13,628 [ERROR] model.py:30 - [Model] >>> Exception:No module named 'atb_llm'
Traceback (most recent call last):
File "/usr/local/Ascend/mindie/latest/mindie-service/bin/model.py", line 28, in initialize
return self.python_model.initialize(config)
File "/usr/local/Ascend/mindie/latest/mindie-service/bin/standard_model.py", line 24, in initialize
self.model = WrapperFactory.get_model_wrapper(model_config)
File "/usr/local/Ascend/mindie/latest/mindie-service/bin/utils/wrapper_factory.py", line 22, in get_model_wrapper
from utils.atb_wrapper import StandardATBModelWrapper
File "/usr/local/Ascend/mindie/latest/mindie-service/bin/utils/atb_wrapper.py", line 8, in <module>
from atb_llm.runner import ModelRunner
ModuleNotFoundError: No module named 'atb_llm'
2024-07-14 01:05:13,628 [ERROR] model.py:33 - [Model] >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}
----------------------------------------------------------------
当前python的环境为3.10.0 pip也指向了这个python版本
但是不知道为什么mindie推理一直报错 特别奇怪
Traceback (most recent call last):
File "/usr/local/Ascend/mindie/latest/mindie-service/bin/model.py", line 28, in initialize
return self.python_model.initialize(config)
File "/usr/local/Ascend/mindie/latest/mindie-service/bin/standard_model.py", line 24, in initialize
self.model = WrapperFactory.get_model_wrapper(model_config)
File "/usr/local/Ascend/mindie/latest/mindie-service/bin/utils/wrapper_factory.py", line 22, in get_model_wrapper
from utils.atb_wrapper import StandardATBModelWrapper
File "/usr/local/Ascend/mindie/latest/mindie-service/bin/utils/atb_wrapper.py", line 8, in <module>
from atb_llm.runner import ModelRunner
ModuleNotFoundError: No module named 'atb_llm'
2024-07-14 01:05:13,628 [ERROR] model.py:33 - [Model] >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}
----------------------------------------------------------------
当前python的环境为3.10.0 pip也指向了这个python版本
但是不知道为什么mindie推理一直报错 特别奇怪