求助各位大佬,310P3卡用官方给的7.2.RC1-300I-Duo-aarch64版本镜像(swr.cn-south-1.myhuaweicloud.com/ascendhub/mis-tei:7.2.RC1-300I-Duo-aarch64)下载后命名如下,
(base) [root@localhost root]# docker images | grep -E "mis-tei|ascendhub"
mis-tei_atlas_310p v0 7836efdb3f3b 5 weeks ago 25.7GB
swr.cn-south-1.myhuaweicloud.com/ascendhub/mis-tei 7.2.RC1-300I-Duo-aarch64 7836efdb3f3b 5 weeks ago 25.7GB
容器正常启动,但是执行命令bash start.sh Qwen3-Embedding-0.6B 127.0.0.1 9000 报错,
启动命令:
docker run -it -u root --privileged=true \
-e TEI_NPU_DEVICE=0 --name=qwen3-embedding --net=host \
-v /home/vllmModel:/home/HwHiAiUser/model \
-e DISABLE_OPTIMIZATION=True \
-e ENABLE_BOOST=False \
-e POOLING=mean \
-e MODEL_ID=Qwen3-Embedding-0.6B \
-e DISABLE_MODEL_DOWNLOAD=True \
--device=/dev/davinci_manager \
--device=/dev/hisi_hdc \
--device=/dev/devmm_svm \
--device=/dev/davinci0 \
-v /usr/local/Ascend/driver:/usr/local/Ascend/driver:ro \
-v /usr/local/sbin:/usr/local/sbin:ro \
mis-tei_atlas_310p:v0 \
Qwen3-Embedding-0.6B 127.0.0.1 9000
报错内容:
Model '/home/HwHiAiUser/model/Qwen3-Embedding-0.6B' exists.
Starting TEI service on 127.0.0.1:9000...
/home/HwHiAiUser/start.sh: line 57: 50 Illegal instruction (core dumped) text-embeddings-router --model-id "${MODEL_ID##*/}" --port "${LISTEN_PORT}" --hostname "${LISTEN_IP}"
求助各位大佬,310P3卡用官方给的7.2.RC1-300I-Duo-aarch64版本镜像(swr.cn-south-1.myhuaweicloud.com/ascendhub/mis-tei:7.2.RC1-300I-Duo-aarch64)下载后命名如下,
(base) [root@localhost root]# docker images | grep -E "mis-tei|ascendhub"
mis-tei_atlas_310p v0 7836efdb3f3b 5 weeks ago 25.7GB
swr.cn-south-1.myhuaweicloud.com/ascendhub/mis-tei 7.2.RC1-300I-Duo-aarch64 7836efdb3f3b 5 weeks ago 25.7GB
容器正常启动,但是执行命令bash start.sh Qwen3-Embedding-0.6B 127.0.0.1 9000 报错,
启动命令:
docker run -it -u root --privileged=true \
-e TEI_NPU_DEVICE=0 --name=qwen3-embedding --net=host \
-v /home/vllmModel:/home/HwHiAiUser/model \
-e DISABLE_OPTIMIZATION=True \
-e ENABLE_BOOST=False \
-e POOLING=mean \
-e MODEL_ID=Qwen3-Embedding-0.6B \
-e DISABLE_MODEL_DOWNLOAD=True \
--device=/dev/davinci_manager \
--device=/dev/hisi_hdc \
--device=/dev/devmm_svm \
--device=/dev/davinci0 \
-v /usr/local/Ascend/driver:/usr/local/Ascend/driver:ro \
-v /usr/local/sbin:/usr/local/sbin:ro \
mis-tei_atlas_310p:v0 \
Qwen3-Embedding-0.6B 127.0.0.1 9000
报错内容:
Model '/home/HwHiAiUser/model/Qwen3-Embedding-0.6B' exists.
Starting TEI service on 127.0.0.1:9000...
/home/HwHiAiUser/start.sh: line 57: 50 Illegal instruction (core dumped) text-embeddings-router --model-id "${MODEL_ID##*/}" --port "${LISTEN_PORT}" --hostname "${LISTEN_IP}"