mis-tei运行报错问题
收藏回复举报
mis-tei运行报错问题
t('forum.solved') 已解决
新人帖
发表于2025-03-12 10:26:42
0 查看

各组件版本

驱动 ==> 24.1.rc3
固件 ==> 7.5.0.1.129

运行命令

docker run  -itd \
--name=tei-large \
--net=host \
--privileged \
-v /usr/local/Ascend/driver:/usr/local/Ascend/driver:ro \
-v /usr/local/sbin:/usr/local/sbin:ro \
-e TEI_NPU_DEVICE=2 \
-v /home/aimp/artifacts/bge-large-zh-v1.5:/home/HwHiAiUser/model \
--entrypoint /home/HwHiAiUser/start.sh \
swr.cn-south-1.myhuaweicloud.com/ascendhub/mis-tei:6.0.RC3-300I-Duo-aarch64 BAAI/bge-large-zh-v1.5 10.10.206.123 8008

报错

true

/home/HwHiAiUser/start.sh: line 13: cut: command not found
/home/HwHiAiUser/start.sh: line 18: sleep: command not found
Model '' exists.
/home/HwHiAiUser/Ascend/ascend-toolkit/set_env.sh: line 2: arch: command not found
Starting TEI service on 10.10.206.123:8008...
2025-03-12T02:19:33.793748Z  INFO text_embeddings_router: router/src/main.rs:140: Args { model_id: "/hom*/**********/**del/", revision: None, tokenization_workers: None, dtype: None, pooling: None, max_concurrent_requests: 512, max_batch_tokens: 16384, max_batch_requests: None, max_client_batch_size: 32, auto_truncate: false, hf_api_token: None, hostname: "10.10.206.123", port: 8008, uds_path: "/tmp/text-embeddings-inference-server", huggingface_hub_cache: None, payload_limit: 2000000, api_key: None, json_output: false, otlp_endpoint: None, cors_allow_origin: None }
2025-03-12T02:19:33.812321Z  INFO text_embeddings_router: router/src/lib.rs:169: Maximum number of tokens per request: 512
2025-03-12T02:19:33.814658Z  INFO text_embeddings_core::tokenization: core/src/tokenization.rs:23: Starting 96 tokenization workers
2025-03-12T02:19:34.335935Z  INFO text_embeddings_router: router/src/lib.rs:198: Starting model backend
2025-03-12T02:19:34.337094Z  INFO text_embeddings_backend_python::management: backends/python/src/management.rs:54: Starting Python backend
Error: Could not create backend

Caused by:
    Could not start backend: Permission denied (os error 13)

求助问题

command not found

命令没有发现问题
/home/HwHiAiUser/start.sh: line 13: cut: command not found
/home/HwHiAiUser/start.sh: line 18: sleep: command not found
/home/HwHiAiUser/Ascend/ascend-toolkit/set_env.sh: line 2: arch: command not found

模型存在读取不到信息

Model '' exists.

backend创建失败

Error: Could not create backend

我要发帖子