使用的是两块300i-duo显卡,驱动装的是2月28日的最新版。下载了最新的2.0.RC1-300I-Duo-py311-openeuler24.03-lts镜像,按照原来1.0的思路部署的。启动时候报错,内容如下:
[root@atlas300i-01 mindie-service]# ./bin/mindieservice_daemon
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
LLMInferEngine failed to init LLMInferModels
Killed
然后查看debug目录下的文件显示:
2025-05-08 19:20:34.024 848 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-05-08 19:20:34.024] [846] [281473412751328] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-05-08 19:20:38.401] [846] [281473412751328] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: NotImplementedError: unsupported model type: qwen3;请确认atb_llm.models路径下是否存在名为qwen3的文件夹。
At:
/usr/local/Ascend/atb-models/atb_llm/models/__init__.py(94): get_model
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
[2025-05-08 19:20:38.402] [846] [281473412751328] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: NotImplementedError: unsupported model type: qwen3;请确认atb_llm.models路径下是否存在名为qwen3的文件夹。
At:
/usr/local/Ascend/atb-models/atb_llm/models/__init__.py(94): get_model
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
才发现原来/usr/local/Ascend/atb-models/atb_llm/models目录下没qwen3的文件夹。我也查了下transformers版本也是4.44.0的
请问最新的2.0rc1镜像中,atb-models没有qwen3目录吗?是依然不支持qwen3吗?
使用的是两块300i-duo显卡,驱动装的是2月28日的最新版。下载了最新的2.0.RC1-300I-Duo-py311-openeuler24.03-lts镜像,按照原来1.0的思路部署的。启动时候报错,内容如下:
[root@atlas300i-01 mindie-service]# ./bin/mindieservice_daemon
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
LLMInferEngine failed to init LLMInferModels
Killed
然后查看debug目录下的文件显示:
2025-05-08 19:20:34.024 848 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-05-08 19:20:34.024] [846] [281473412751328] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-05-08 19:20:38.401] [846] [281473412751328] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: NotImplementedError: unsupported model type: qwen3;请确认atb_llm.models路径下是否存在名为qwen3的文件夹。
At:
/usr/local/Ascend/atb-models/atb_llm/models/__init__.py(94): get_model
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
[2025-05-08 19:20:38.402] [846] [281473412751328] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: NotImplementedError: unsupported model type: qwen3;请确认atb_llm.models路径下是否存在名为qwen3的文件夹。
At:
/usr/local/Ascend/atb-models/atb_llm/models/__init__.py(94): get_model
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
才发现原来/usr/local/Ascend/atb-models/atb_llm/models目录下没qwen3的文件夹。我也查了下transformers版本也是4.44.0的
请问最新的2.0rc1镜像中,atb-models没有qwen3目录吗?是依然不支持qwen3吗?