text-embeddings-router启动报错
收藏回复举报
text-embeddings-router启动报错
t('forum.solved') 已解决
新人帖
发表于2025-04-28 15:04:35
0 查看
 

 text-embeddings-router --model-id /data/embedding/bge-m3  --dtype float32 --pooling cls --max-concurrent-requests 2048 --max-batch-requests 2048 --max-batch-tokens 1100000 --max-client-batch-size 256 --port 12347 

2025-04-28T06:56:34.224443Z  INFO text_embeddings_router: router/src/main.rs:140: Args { model_id: "/dat*/*********/**e-m3", revision: None, tokenization_workers: None, dtype: Some(Float32), pooling: Some(Cls), max_concurrent_requests: 2048, max_batch_tokens: 1100000, max_batch_requests: Some(2048), max_client_batch_size: 256, auto_truncate: false, hf_api_token: None, hostname: "ascend02.cpc.gdmain.com", port: 12347, uds_path: "/tmp/text-embeddings-inference-server", huggingface_hub_cache: None, payload_limit: 2000000, api_key: None, json_output: false, otlp_endpoint: None, cors_allow_origin: None } 

2025-04-28T06:56:34.665504Z  INFO text_embeddings_router: router/src/lib.rs:169: Maximum number of tokens per request: 8192 

2025-04-28T06:56:34.665992Z  INFO text_embeddings_core::tokenization: core/src/tokenization.rs:23: Starting 64 tokenization workers 

2025-04-28T06:56:44.262703Z  INFO text_embeddings_router: router/src/lib.rs:194: Starting model backend 

2025-04-28T06:56:44.263023Z  INFO text_embeddings_backend_python::management: backends/python/src/management.rs:54: Starting Python backend 

Error: Could not create backend 

 

Caused by: 

    Could not start backend: Python backend failed to start 

使用的是官方提供的swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:1.0.0-300I-Duo-py311-openeuler24.03-lts镜像

按照教程安装tel环境后,启动报错,怎么能看到详细的信息输出,无法确定是哪出了问题

硬件信息如下

cke_14424.png

我要发帖子