msi-tei镜像启动embedding出错
t('forum.solved') 已解决
发表于2026-01-08 10:45:03

求助各位大佬,310P3卡用官方给的7.2.RC1-300I-Duo-aarch64版本镜像(swr.cn-south-1.myhuaweicloud.com/ascendhub/mis-tei:7.2.RC1-300I-Duo-aarch64)下载后命名如下,

(base) [root@localhost root]# docker images | grep -E "mis-tei|ascendhub"

mis-tei_atlas_310p                                               v0                                        7836efdb3f3b   5 weeks ago     25.7GB

swr.cn-south-1.myhuaweicloud.com/ascendhub/mis-tei               7.2.RC1-300I-Duo-aarch64                  7836efdb3f3b   5 weeks ago     25.7GB

容器正常启动,但是执行命令bash start.sh Qwen3-Embedding-0.6B 127.0.0.1 9000 报错,

启动命令:

docker run -it -u root --privileged=true \

-e TEI_NPU_DEVICE=0 --name=qwen3-embedding --net=host \

-v /home/vllmModel:/home/HwHiAiUser/model \

-e DISABLE_OPTIMIZATION=True \

-e ENABLE_BOOST=False \

-e POOLING=mean \

-e MODEL_ID=Qwen3-Embedding-0.6B \

-e DISABLE_MODEL_DOWNLOAD=True \

--device=/dev/davinci_manager \

--device=/dev/hisi_hdc \

--device=/dev/devmm_svm \

--device=/dev/davinci0  \

-v /usr/local/Ascend/driver:/usr/local/Ascend/driver:ro \

-v /usr/local/sbin:/usr/local/sbin:ro \

mis-tei_atlas_310p:v0 \

Qwen3-Embedding-0.6B 127.0.0.1 9000

报错内容:

Model '/home/HwHiAiUser/model/Qwen3-Embedding-0.6B' exists.

Starting TEI service on 127.0.0.1:9000...

/home/HwHiAiUser/start.sh: line 57:    50 Illegal instruction     (core dumped) text-embeddings-router --model-id "${MODEL_ID##*/}" --port "${LISTEN_PORT}" --hostname "${LISTEN_IP}"

本帖最后由 匿名用户2026/01/08 11:56:18 编辑

新人帖
发表于2026/01/08