vllm问题解决案例分享:
收藏回复举报
vllm问题解决案例分享:
发表于2025-03-31 14:25:30
0 查看

问题:运行vllm-ascend遇到报错: multiproc_worker_utils.py:242] RuntimeError: Cannot re-initialize NPU in forked subprocess. To use NPU with multiprocessing, you must use the 'spawn' start method.

 

解决方法:启动方式改成->

if __name__ == '__main__': 

    import vllm 

 

    llm = vllm.LLM(...) 

我要发帖子