基于mindIE230&910b4单卡拉起GLM-4VL-9B服务化时报错,无法启动
收藏回复举报
基于mindIE230&910b4单卡拉起GLM-4VL-9B服务化时报错,无法启动
t('forum.solved') 已解决
发表于2026-02-09 15:33:54
0 查看

基于mindIE230&910b4单卡,使用docker搭建GLM-4V-9B容器,修改服务化启动配置文件configjson中,ipddress/managementIpAddress/port/httpsEnabled/npuDeviceIds/modelName/modelWeightPath/worldSize,配置关闭https服务,单卡拉起模型服务,报错

nohup ./bin/mindieservice_daemon > output.log 2>&1
[root@openlab mindie-service]# source /usr/local/Ascend/ascend-toolkit/set_env.sh
source /usr/local/Ascend/nnal/atb/set_env.sh
source /usr/local/Ascend/atb-models/set_env.sh
source /usr/local/Ascend/mindie/set_env.sh
[root@openlab mindie-service]# nohup ./bin/mindieservice_daemon > output.log 2>&1 &
[1] 23798
[root@openlab mindie-service]# tail -100f output.log
nohup: ignoring input
g_mainPid = 23798
LogLevelDynamicHandler start
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
ConfigManager: Load Config from /usr/local/Ascend/mindie/2.3.0/mindie-service/conf/config.json.
The configName speculationGamma is not found, use default value.
[ConfigManager::ExecuteConfigInteractions] Configuration interactions completed successfully
[ConfigManager::InitConfigManager] Successfully init config manager
LogLevelDynamicHandler start
LogLevelDynamicHandler start
[2026-02-09 11:22:20,861] [25085] [281467419678560] [tokenizer] [ERROR] [tokenizer.py-84] : IbisTokenizer init failed!!!
Traceback (most recent call last):
  File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 378, in wrapper
    return func(model_path, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 393, in safe_get_tokenizer_from_pretrained
    return AutoTokenizer.from_pretrained(model_path, local_files_only=True, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/tokenization_auto.py", line 980, in from_pretrained
    trust_remote_code = resolve_trust_remote_code(
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 696, in resolve_trust_remote_code
    raise ValueError(
ValueError: Loading /data/models/GLM-4V-9B requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option `trust_remote_code=True` to remove this error.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/mies_tokenizer/tokenizer.py", line 76, in __init__
    wrapper = get_tokenizer_wrapper(
              ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py", line 28, in get_tokenizer_wrapper
    return wrapper_cls(model_id, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py", line 9, in __init__
    self.tokenizer_wrapper = TokenizerWrapper(model_id, **kwargs)
                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py", line 33, in __init__
    self.tokenizer = router_ins.tokenizer
                     ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/Ascend/atb-models/atb_llm/models/base/router.py", line 249, in tokenizer
    self._tokenizer = self.get_tokenizer()
                      ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/Ascend/atb-models/atb_llm/models/base/router.py", line 541, in get_tokenizer
    return safe_get_tokenizer_from_pretrained(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 386, in wrapper
    raise ValueError(f"{func.__name__} failed. " + EXTRA_EXP_INFO) from filtered_error
ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path, kwargs and the version of transformers. If the input parameters are valid, the required files exist in model_path and the version of transformers is correct, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information and the logs of the llmmodels.

我要发帖子