基于mindIE230&910b4单卡,使用docker搭建GLM-4V-9B容器,修改服务化启动配置文件configjson中,ipddress/managementIpAddress/port/httpsEnabled/npuDeviceIds/modelName/modelWeightPath/worldSize,配置关闭https服务,单卡拉起模型服务,报错
nohup ./bin/mindieservice_daemon > output.log 2>&1
[root@openlab mindie-service]# source /usr/local/Ascend/ascend-toolkit/set_env.sh
source /usr/local/Ascend/nnal/atb/set_env.sh
source /usr/local/Ascend/atb-models/set_env.sh
source /usr/local/Ascend/mindie/set_env.sh
[root@openlab mindie-service]# nohup ./bin/mindieservice_daemon > output.log 2>&1 &
[1] 23798
[root@openlab mindie-service]# tail -100f output.log
nohup: ignoring input
g_mainPid = 23798
LogLevelDynamicHandler start
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
ConfigManager: Load Config from /usr/local/Ascend/mindie/2.3.0/mindie-service/conf/config.json.
The configName speculationGamma is not found, use default value.
[ConfigManager::ExecuteConfigInteractions] Configuration interactions completed successfully
[ConfigManager::InitConfigManager] Successfully init config manager
LogLevelDynamicHandler start
LogLevelDynamicHandler start
[2026-02-09 11:22:20,861] [25085] [281467419678560] [tokenizer] [ERROR] [tokenizer.py-84] : IbisTokenizer init failed!!!
Traceback (most recent call last):
File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 378, in wrapper
return func(model_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 393, in safe_get_tokenizer_from_pretrained
return AutoTokenizer.from_pretrained(model_path, local_files_only=True, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/tokenization_auto.py", line 980, in from_pretrained
trust_remote_code = resolve_trust_remote_code(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 696, in resolve_trust_remote_code
raise ValueError(
ValueError: Loading /data/models/GLM-4V-9B requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option `trust_remote_code=True` to remove this error.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/mies_tokenizer/tokenizer.py", line 76, in __init__
wrapper = get_tokenizer_wrapper(
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py", line 28, in get_tokenizer_wrapper
return wrapper_cls(model_id, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py", line 9, in __init__
self.tokenizer_wrapper = TokenizerWrapper(model_id, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py", line 33, in __init__
self.tokenizer = router_ins.tokenizer
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/base/router.py", line 249, in tokenizer
self._tokenizer = self.get_tokenizer()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/base/router.py", line 541, in get_tokenizer
return safe_get_tokenizer_from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 386, in wrapper
raise ValueError(f"{func.__name__} failed. " + EXTRA_EXP_INFO) from filtered_error
ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path, kwargs and the version of transformers. If the input parameters are valid, the required files exist in model_path and the version of transformers is correct, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information and the logs of the llmmodels.
基于mindIE230&910b4单卡,使用docker搭建GLM-4V-9B容器,修改服务化启动配置文件configjson中,ipddress/managementIpAddress/port/httpsEnabled/npuDeviceIds/modelName/modelWeightPath/worldSize,配置关闭https服务,单卡拉起模型服务,报错
nohup ./bin/mindieservice_daemon > output.log 2>&1
[root@openlab mindie-service]# source /usr/local/Ascend/ascend-toolkit/set_env.sh
source /usr/local/Ascend/nnal/atb/set_env.sh
source /usr/local/Ascend/atb-models/set_env.sh
source /usr/local/Ascend/mindie/set_env.sh
[root@openlab mindie-service]# nohup ./bin/mindieservice_daemon > output.log 2>&1 &
[1] 23798
[root@openlab mindie-service]# tail -100f output.log
nohup: ignoring input
g_mainPid = 23798
LogLevelDynamicHandler start
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
ConfigManager: Load Config from /usr/local/Ascend/mindie/2.3.0/mindie-service/conf/config.json.
The configName speculationGamma is not found, use default value.
[ConfigManager::ExecuteConfigInteractions] Configuration interactions completed successfully
[ConfigManager::InitConfigManager] Successfully init config manager
LogLevelDynamicHandler start
LogLevelDynamicHandler start
[2026-02-09 11:22:20,861] [25085] [281467419678560] [tokenizer] [ERROR] [tokenizer.py-84] : IbisTokenizer init failed!!!
Traceback (most recent call last):
File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 378, in wrapper
return func(model_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 393, in safe_get_tokenizer_from_pretrained
return AutoTokenizer.from_pretrained(model_path, local_files_only=True, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/tokenization_auto.py", line 980, in from_pretrained
trust_remote_code = resolve_trust_remote_code(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 696, in resolve_trust_remote_code
raise ValueError(
ValueError: Loading /data/models/GLM-4V-9B requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option `trust_remote_code=True` to remove this error.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/mies_tokenizer/tokenizer.py", line 76, in __init__
wrapper = get_tokenizer_wrapper(
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py", line 28, in get_tokenizer_wrapper
return wrapper_cls(model_id, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py", line 9, in __init__
self.tokenizer_wrapper = TokenizerWrapper(model_id, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py", line 33, in __init__
self.tokenizer = router_ins.tokenizer
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/base/router.py", line 249, in tokenizer
self._tokenizer = self.get_tokenizer()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/base/router.py", line 541, in get_tokenizer
return safe_get_tokenizer_from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py", line 386, in wrapper
raise ValueError(f"{func.__name__} failed. " + EXTRA_EXP_INFO) from filtered_error
ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path, kwargs and the version of transformers. If the input parameters are valid, the required files exist in model_path and the version of transformers is correct, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information and the logs of the llmmodels.