MindIE 1.0.0启动Server报'ModelRunner' object has no attribute 'generate_position_ids'异常
收藏回复举报
MindIE 1.0.0启动Server报'ModelRunner' object has no attribute 'generate_position_ids'异常
t('forum.solved') 已解决
新人帖
发表于2025-01-14 11:32:37
0 查看

相关版本信息

显卡:910B1

Python:3.10.15

PyTorch:2.1.0

CANN:8.0.0

MindIE:1.0.0

atb-llm:0.0.1

具体异常信息如下

Traceback (most recent call last): 

  File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/model_wrapper/model.py", line 37, in initialize 

    return self.python_model.initialize(config) 

  File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/model_wrapper/standard_model.py", line 146, in initialize 

    self.generator = Generator( 

  File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/text_generator/generator.py", line 119, in __init__ 

    self.warm_up(max_prefill_tokens, max_seq_len, max_input_len, max_iter_times, inference_mode) 

  File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/text_generator/generator.py", line 296, in warm_up 

    self._generate_inputs_warm_up_backend(input_metadata, inference_mode, dummy=True) 

  File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/text_generator/generator.py", line 376, in _generate_inputs_warm_up_backend 

    model_inputs, _, _, _ = input_manager.concatenate(input_metadata, None, True, dummy=dummy) 

  File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/text_generator/utils/input_manager.py", line 84, in concatenate 

    position_ids[start_idx:end_idx] = self.model_wrapper.generate_position_ids(input_ids[start_idx:end_idx]) 

  File "/home/ma-user/python3.10.15/lib/python3.10/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 131, in generate_position_ids 

    return self.model_runner.generate_position_ids(input_ids) 

AttributeError: 'ModelRunner' object has no attribute 'generate_position_ids'

我要发帖子