使用mindie:2.0.T3.1-800I-A2-py311-openeuler24.03-lts 部署 deepseek-r1-bf16成功了。
但是部署deepseek-v3-0324-w8a8报错，服务无法启动。
[2025-04-24 16:06:20,429] [1087] [281471573619040] [llm] [INFO] [dist.py-81] : initialize_distributed has been Set
[2025-04-24 16:06:22,936] [1083] [281471167033696] [llm] [INFO] [logging.py-331] : NPUSocInfo(soc_name='', soc_version=221, need_nz=False, matmul_nd_nz=False)
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
/usr/lib64/python3.11/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 30 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
Daemon is killing...
点赞
收藏
回复
分享
举报
已解决
使用mindie:2.0.T3.1-800I-A2-py311-openeuler24.03-lts 部署 deepseek-r1-bf16成功了。
但是部署deepseek-v3-0324-w8a8报错，服务无法启动。
[2025-04-24 16:06:20,429] [1087] [281471573619040] [llm] [INFO] [dist.py-81] : initialize_distributed has been Set
[2025-04-24 16:06:22,936] [1083] [281471167033696] [llm] [INFO] [logging.py-331] : NPUSocInfo(soc_name='', soc_version=221, need_nz=False, matmul_nd_nz=False)
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
/usr/lib64/python3.11/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 30 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
Daemon is killing...