/home/HwHiAiUser/start.sh: line 13: cut: command not found
/home/HwHiAiUser/start.sh: line 18: sleep: command not found
Model '' exists.
/home/HwHiAiUser/Ascend/ascend-toolkit/set_env.sh: line 2: arch: command not found
Starting TEI service on 10.10.206.123:8008...
2025-03-12T02:19:33.793748Z INFO text_embeddings_router: router/src/main.rs:140: Args { model_id: "/hom*/**********/**del/", revision: None, tokenization_workers: None, dtype: None, pooling: None, max_concurrent_requests: 512, max_batch_tokens: 16384, max_batch_requests: None, max_client_batch_size: 32, auto_truncate: false, hf_api_token: None, hostname: "10.10.206.123", port: 8008, uds_path: "/tmp/text-embeddings-inference-server", huggingface_hub_cache: None, payload_limit: 2000000, api_key: None, json_output: false, otlp_endpoint: None, cors_allow_origin: None }
2025-03-12T02:19:33.812321Z INFO text_embeddings_router: router/src/lib.rs:169: Maximum number of tokens per request: 512
2025-03-12T02:19:33.814658Z INFO text_embeddings_core::tokenization: core/src/tokenization.rs:23: Starting 96 tokenization workers
2025-03-12T02:19:34.335935Z INFO text_embeddings_router: router/src/lib.rs:198: Starting model backend
2025-03-12T02:19:34.337094Z INFO text_embeddings_backend_python::management: backends/python/src/management.rs:54: Starting Python backend
Error: Could not create backend
Caused by:
Could not start backend: Permission denied (os error 13)
求助问题
command not found
命令没有发现问题
/home/HwHiAiUser/start.sh: line 13: cut: command not found
/home/HwHiAiUser/start.sh: line 18: sleep: command not found
/home/HwHiAiUser/Ascend/ascend-toolkit/set_env.sh: line 2: arch: command not found
各组件版本
运行命令
报错
/home/HwHiAiUser/start.sh: line 13: cut: command not found /home/HwHiAiUser/start.sh: line 18: sleep: command not found Model '' exists. /home/HwHiAiUser/Ascend/ascend-toolkit/set_env.sh: line 2: arch: command not found Starting TEI service on 10.10.206.123:8008... 2025-03-12T02:19:33.793748Z INFO text_embeddings_router: router/src/main.rs:140: Args { model_id: "/hom*/**********/**del/", revision: None, tokenization_workers: None, dtype: None, pooling: None, max_concurrent_requests: 512, max_batch_tokens: 16384, max_batch_requests: None, max_client_batch_size: 32, auto_truncate: false, hf_api_token: None, hostname: "10.10.206.123", port: 8008, uds_path: "/tmp/text-embeddings-inference-server", huggingface_hub_cache: None, payload_limit: 2000000, api_key: None, json_output: false, otlp_endpoint: None, cors_allow_origin: None } 2025-03-12T02:19:33.812321Z INFO text_embeddings_router: router/src/lib.rs:169: Maximum number of tokens per request: 512 2025-03-12T02:19:33.814658Z INFO text_embeddings_core::tokenization: core/src/tokenization.rs:23: Starting 96 tokenization workers 2025-03-12T02:19:34.335935Z INFO text_embeddings_router: router/src/lib.rs:198: Starting model backend 2025-03-12T02:19:34.337094Z INFO text_embeddings_backend_python::management: backends/python/src/management.rs:54: Starting Python backend Error: Could not create backend Caused by: Could not start backend: Permission denied (os error 13)求助问题
command not found
模型存在读取不到信息
backend创建失败