使用2.0.RC1-300I-Duo-py311-openeuler24.03-lts镜像部署Qwen3的问题
收藏回复举报
使用2.0.RC1-300I-Duo-py311-openeuler24.03-lts镜像部署Qwen3的问题
t('forum.solved') 已解决
新人帖
发表于2025-05-08 19:27:44
0 查看

使用的是两块300i-duo显卡,驱动装的是2月28日的最新版。下载了最新的2.0.RC1-300I-Duo-py311-openeuler24.03-lts镜像,按照原来1.0的思路部署的。启动时候报错,内容如下:

[root@atlas300i-01 mindie-service]# ./bin/mindieservice_daemon

The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.

The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.

The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.

The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.

The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.

The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.

The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.

The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.

The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.

The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.

The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.

The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.

LLMInferEngine failed to init LLMInferModels

Killed

然后查看debug目录下的文件显示:

2025-05-08 19:20:34.024 848 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg

[2025-05-08 19:20:34.024] [846] [281473412751328] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!

[2025-05-08 19:20:38.401] [846] [281473412751328] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: NotImplementedError: unsupported model type: qwen3;请确认atb_llm.models路径下是否存在名为qwen3的文件夹。

At:

  /usr/local/Ascend/atb-models/atb_llm/models/__init__.py(94): get_model

  /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper

[2025-05-08 19:20:38.402] [846] [281473412751328] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: NotImplementedError: unsupported model type: qwen3;请确认atb_llm.models路径下是否存在名为qwen3的文件夹。

At:

  /usr/local/Ascend/atb-models/atb_llm/models/__init__.py(94): get_model

  /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper

才发现原来/usr/local/Ascend/atb-models/atb_llm/models目录下没qwen3的文件夹。我也查了下transformers版本也是4.44.0的

请问最新的2.0rc1镜像中,atb-models没有qwen3目录吗?是依然不支持qwen3吗?

我要发帖子