llama2推理时报错The loaded parameter dict is empty after filter or specify,
收藏回复举报
llama2推理时报错The loaded parameter dict is empty after filter or specify,
t('forum.solved') 已解决
新人帖
发表于2024-03-28 17:43:32
0 查看

如题,执行 python run_mindformer.py --config ./configs/llama2/run_llama2_7b_for_predict.yaml --run_mode predict --predict_data 'I love Beijing, because' --use_parallel False

报错 如下:

Traceback (most recent call last): 

  File "run_mindformer.py", line 420, in <module> 

    main(config_) 

  File "/home/ma-user/work/LHT/mindformers/mindformers/tools/cloud_adapter/cloud_monitor.py", line 44, in wrapper 

    raise exc 

  File "/home/ma-user/work/LHT/mindformers/mindformers/tools/cloud_adapter/cloud_monitor.py", line 34, in wrapper 

    result = run_func(*args, **kwargs) 

  File "run_mindformer.py", line 145, in main 

    create_task_trainer(config) 

  File "run_mindformer.py", line 91, in create_task_trainer 

    trainer.predict(config, is_full_config=True, batch_size=config.predict_batch_size) 

  File "/home/ma-user/work/LHT/mindformers/mindformers/trainer/causal_language_modeling/causal_language_modeling.py", line 315, in predict 

    return self.predict_process(config=config, 

  File "/home/ma-user/work/LHT/mindformers/mindformers/trainer/base_trainer.py", line 868, in predict_process 

    transform_and_load_checkpoint(config, model, network, None, do_predict=True) 

  File "/home/ma-user/work/LHT/mindformers/mindformers/trainer/utils.py", line 346, in transform_and_load_checkpoint 

    load_ckpt(config, network, optimizer=optimizer) 

  File "/home/ma-user/work/LHT/mindformers/mindformers/trainer/utils.py", line 707, in load_ckpt 

    checkpoint_dict.update(load_distributed_checkpoint(checkpoint_path)) 

  File "/home/ma-user/work/LHT/mindformers/mindformers/trainer/utils.py", line 257, in load_distributed_checkpoint 

    checkpoint_dict = load_checkpoint(distribute_checkpoint_path, specify_prefix=specify_prefix) 

  File "/home/ma-user/miniconda3/envs/ms2.0MixPre/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1097, in load_checkpoint 

    raise ValueError(f"The loaded parameter dict is empty after filter or specify, please check whether " 

ValueError: The loaded parameter dict is empty after filter or specify, please check whether 'filter_prefix' or 'specify_prefix' are set correctly.

我要发帖子