MindIE镜像推理微调后的qwen1.5-7B报错
收藏回复举报
MindIE镜像推理微调后的qwen1.5-7B报错
t('forum.solved') 已解决
发表于2024-11-01 16:14:42
0 查看

原模型能在mindie镜像下跑通推理,微调后的模型报错:

Traceback (most recent call last):

  File "/usr/local/python3.10.2/lib/python3.10/runpy.py", line 196, in _run_module_as_main

    return _run_code(code, main_globals, None,

  File "/usr/local/python3.10.2/lib/python3.10/runpy.py", line 86, in _run_code

    exec(code, run_globals)

  File "/usr/local/Ascend/llm_model/examples/run_pa.py", line 345, in <module>

    pa_runner = PARunner(**input_dict)

  File "/usr/local/Ascend/llm_model/examples/run_pa.py", line 40, in __init__

    self.model = ModelRunner(

  File "/usr/local/Ascend/llm_model/atb_llm/runner/model_runner.py", line 44, in __init__

    self.config = router_ins.config

  File "/usr/local/Ascend/llm_model/atb_llm/models/base/router.py", line 40, in config

    self._config = self.get_config()

  File "/usr/local/Ascend/llm_model/atb_llm/models/qwen2/router_qwen2.py", line 16, in get_config

    self.checkout_config_qwen(config)

  File "/usr/local/Ascend/llm_model/atb_llm/models/qwen2/router_qwen2.py", line 39, in checkout_config_qwen

    if value < min_val or value > max_val:

TypeError: '<' not supported between instances of 'NoneType' and 'int'

[ERROR] 2024-11-01-08:10:42 (PID:134133, Device:-1, RankID:-1) ERR99999 UNKNOWN application exception

[2024-11-01 08:10:45,284] torch.distributed.elastic.multiprocessing.api: [ERROR] failed (exitcode: 1) local_rank: 0 (pid: 134128) of binary: /usr/local/python3.10.2/bin/python3.10

我要发帖子