多模型部署报错了
收藏回复举报
多模型部署报错了
t('forum.solved') 已解决
发表于2025-07-30 14:19:21
0 查看

同一台设备中,我使用0卡docker部署了qwen-14b-instruct模型,启动成功, 1卡docker部署了qwen-vl-7b-instruct,启动的时候报错了:socket端口被占用了,这个需要我去哪里修改呢?

: [MIE04E020407] [endpoint] Socket bind failed, bind_result is -1. Address already in use 

[2025-07-30 14:14:47.544+08:00] [2721] [2723] [server] [ERROR] [http_server.cpp:277] : [MIE04E020407] [endpoint] Management or Business or Metrics Http server listen port is occupied 

[2025-07-30 14:14:47.544+08:00] [2721] [2723] [server] [ERROR] [endpoint.cpp:99] : [MIE04E02011C] [endpoint] Failed to start http wrapper 

[2025-07-30 14:14:47.544+08:00] [2721] [userver] [system] [server] [Start mindie server] [fail] 

[2025-07-30 14:14:58.269+08:00] [2721] [userver] [system] [server] [start endpoint] [fail] 

[2025-07-30 14:14:58.269+08:00] [2721] [userver] [system] [server] [start mindie server] [fail] 

[2025-07-30 14:14:58.269+08:00] [2721] [2723] [server] [ERROR] [llm_daemon.cpp:160] : [MIE04E01011C] [daemon] Failed to init endpoint! Please check the service log or console output. 

Killed

我要发帖子