mindie镜像版本为:swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:1.0.RC3-300I-Duo-arm64
执行 ./mindieservice_daemon启动报错,报错信息如下
a800i-01:/usr/local/Ascend/mindie/latest/mindie-service/bin# ./mindieservice_daemon
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https://github.com/huggingface/transformers/issues/31884
warnings.warn(
2024-12-19 08:17:10.496247 1694 error [model_deploy_config.cpp:169] Failed to get vocab size from tokenizer wrapper with exception: AttributeError: 'QWenTokenizer' object has no attribute 'IMAGE_ST'
At:
/root/.cache/huggingface/modules/transformers_modules/Qwen-VL/tokenization_qwen.py(227): _add_tokens
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/tokenization_utils.py(436): __init__
/root/.cache/huggingface/modules/transformers_modules/Qwen-VL/tokenization_qwen.py(120): __init__
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/tokenization_utils_base.py(2506): _from_pretrained
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/tokenization_utils_base.py(2271): from_pretrained
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/models/auto/tokenization_auto.py(882): from_pretrained
/usr/local/Ascend/llm_model/atb_llm/models/qwen/router_qwen.py(52): get_tokenizer
/usr/local/Ascend/llm_model/atb_llm/models/base/router.py(102): tokenizer
/usr/local/Ascend/llm_model/atb_llm/runner/tokenizer_wrapper.py(9): __init__
/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
terminate called after throwing an instance of 'pybind11::error_already_set'
Daemon wait pid with 1691, status 4991
ERR: Daemon wait pid with 1691 exit, Please check the service log or python log.
Daemon is killing...
Killed
mindie镜像版本为:swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:1.0.RC3-300I-Duo-arm64
执行 ./mindieservice_daemon启动报错,报错信息如下
a800i-01:/usr/local/Ascend/mindie/latest/mindie-service/bin# ./mindieservice_daemon
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https://github.com/huggingface/transformers/issues/31884
warnings.warn(
2024-12-19 08:17:10.496247 1694 error [model_deploy_config.cpp:169] Failed to get vocab size from tokenizer wrapper with exception: AttributeError: 'QWenTokenizer' object has no attribute 'IMAGE_ST'
At:
/root/.cache/huggingface/modules/transformers_modules/Qwen-VL/tokenization_qwen.py(227): _add_tokens
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/tokenization_utils.py(436): __init__
/root/.cache/huggingface/modules/transformers_modules/Qwen-VL/tokenization_qwen.py(120): __init__
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/tokenization_utils_base.py(2506): _from_pretrained
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/tokenization_utils_base.py(2271): from_pretrained
/usr/local/python3.11.10/lib/python3.11/site-packages/transformers/models/auto/tokenization_auto.py(882): from_pretrained
/usr/local/Ascend/llm_model/atb_llm/models/qwen/router_qwen.py(52): get_tokenizer
/usr/local/Ascend/llm_model/atb_llm/models/base/router.py(102): tokenizer
/usr/local/Ascend/llm_model/atb_llm/runner/tokenizer_wrapper.py(9): __init__
/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
terminate called after throwing an instance of 'pybind11::error_already_set'
Daemon wait pid with 1691, status 4991
ERR: Daemon wait pid with 1691 exit, Please check the service log or python log.
Daemon is killing...
Killed