G2280服务器,4张300l D的npu跑的deepseek-32b,修改容器使用的npu核心报错
收藏回复举报
G2280服务器,4张300l D的npu跑的deepseek-32b,修改容器使用的npu核心报错
t('forum.solved') 已解决
新人帖
发表于2025-04-28 12:37:14
0 查看

之前 4张8核[0,1,2,3,4,5,7],全用在dp-32上,后需让出部分核心报错。

现象是,同样config配置,4核、8核都能启动成功

6核、7核报错内容节选如下:

 [ERROR] model.py:42 - [Model] >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}  

[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!  

[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!  

[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!  

/usr/lib64/python3.11/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 30 leaked semaphore objects to clean up at shutdown  

warnings.warn('resource_tracker: There appear to be %d '  

Daemon is killing...  

Killed 

我要发帖子