华为计算微信公众号
昇腾AI开发者公众号
华为计算微博
华为计算今日头条
相关版本信息
显卡:910B1
Python:3.10.15
PyTorch:2.1.0
CANN:8.0.0
MindIE:1.0.0
atb-llm:0.0.1
具体异常信息如下
Traceback (most recent call last): File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/model_wrapper/model.py", line 37, in initialize return self.python_model.initialize(config) File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/model_wrapper/standard_model.py", line 146, in initialize self.generator = Generator( File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/text_generator/generator.py", line 119, in __init__ self.warm_up(max_prefill_tokens, max_seq_len, max_input_len, max_iter_times, inference_mode) File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/text_generator/generator.py", line 296, in warm_up self._generate_inputs_warm_up_backend(input_metadata, inference_mode, dummy=True) File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/text_generator/generator.py", line 376, in _generate_inputs_warm_up_backend model_inputs, _, _, _ = input_manager.concatenate(input_metadata, None, True, dummy=dummy) File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/text_generator/utils/input_manager.py", line 84, in concatenate position_ids[start_idx:end_idx] = self.model_wrapper.generate_position_ids(input_ids[start_idx:end_idx]) File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 131, in generate_position_ids return self.model_runner.generate_position_ids(input_ids) AttributeError: 'ModelRunner' object has no attribute 'generate_position_ids'
我要发帖子
相关版本信息
显卡:910B1
Python:3.10.15
PyTorch:2.1.0
CANN:8.0.0
MindIE:1.0.0
atb-llm:0.0.1
具体异常信息如下