Atlas 300I(3000)推理卡是否支持部署deepseek,部署时报错求助
收藏回复举报
Atlas 300I(3000)推理卡是否支持部署deepseek,部署时报错求助
t('forum.solved') 已解决
发表于2025-02-25 10:07:13
0 查看

Atlas 300I(3000)推理卡是否支持部署deepseek,部署时报错求助,查看其他帖子发现说驱动要装23.0.7,但是Atlas 300I(3000)这个型号只有23.0.0版本的驱动,是不是这张卡就不支持部署了。

报错信息:

[2025-02-24 17:31:26,573] torch.distributed.run: [WARNING] [2025-02-24 17:31:26,573] torch.distributed.run: [WARNING] ***************************************** [2025-02-24 17:31:26,573] torch.distributed.run: [WARNING] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. [2025-02-24 17:31:26,573] torch.distributed.run: [WARNING] ***************************************** Traceback (most recent call last): Traceback (most recent call last): File "/usr/local/lib64/python3.11/site-packages/torch_npu/__init__.py", line 17, in File "/usr/local/lib64/python3.11/site-packages/torch_npu/__init__.py", line 17, in import torch_npu.npuimport torch_npu.npu File "/usr/local/lib64/python3.11/site-packages/torch_npu/npu/__init__.py", line 114, in File "/usr/local/lib64/python3.11/site-packages/torch_npu/npu/__init__.py", line 114, in from torch_npu.utils import _should_print_warning from torch_npu.utils import _should_print_warning File "/usr/local/lib64/python3.11/site-packages/torch_npu/utils/__init__.py", line 1, in File "/usr/local/lib64/python3.11/site-packages/torch_npu/utils/__init__.py", line 1, in from torch_npu import _C from torch_npu import _C ImportError: ImportErrorlibascend_hal.so: cannot open shared object file: No such file or directory: libascend_hal.so: cannot open shared object file: No such file or directory During handling of the above exception, another exception occurred: During handling of the above exception, another exception occurred: Traceback (most recent call last): Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 198, in _run_module_as_main File "", line 88, in _run_code File "", line 88, in _run_code File "/usr/local/Ascend/atb-models/examples/run_pa.py", line 10, in File "/usr/local/Ascend/atb-models/examples/run_pa.py", line 10, in import torch_npuimport torch_npu File "/usr/local/lib64/python3.11/site-packages/torch_npu/__init__.py", line 19, in File "/usr/local/lib64/python3.11/site-packages/torch_npu/__init__.py", line 19, in from torch_npu.utils._error_code import ErrCode, pta_error from torch_npu.utils._error_code import ErrCode, pta_error File "/usr/local/lib64/python3.11/site-packages/torch_npu/utils/__init__.py", line 1, in File "/usr/local/lib64/python3.11/site-packages/torch_npu/utils/__init__.py", line 1, in from torch_npu import _C from torch_npu import _C ImportError: ImportErrorlibascend_hal.so: cannot open shared object file: No such file or directory: libascend_hal.so: cannot open shared object file: No such file or directory [2025-02-24 17:31:31,577] torch.distributed.elastic.multiprocessing.api: [ERROR] failed (exitcode: 1) local_rank: 0 (pid: 222) of binary: /usr/bin/python3 Traceback (most recent call last): File "/usr/local/bin/torchrun", line 8, in sys.exit(main()) ^^^^^^ File "/usr/local/lib64/python3.11/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 346, in wrapper return f(*args, **kwargs) ^^^^^^^^^^^^^^^^^^ File "/usr/local/lib64/python3.11/site-packages/torch/distributed/run.py", line 806, in main run(args) File "/usr/local/lib64/python3.11/site-packages/torch/distributed/run.py", line 797, in run elastic_launch( File "/usr/local/lib64/python3.11/site-packages/torch/distributed/launcher/api.py", line 134, in __call__ return launch_agent(self._config, self._entrypoint, list(args)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib64/python3.11/site-packages/torch/distributed/launcher/api.py", line 264, in launch_agent raise ChildFailedError( torch.distributed.elastic.multiprocessing.errors.ChildFailedError: ============================================================ examples.run_pa FAILED ------------------------------------------------------------ Failures: [1]: time : 2025-02-24_17:31:31 host : localhost.localdomain rank : 1 (local_rank: 1) exitcode : 1 (pid: 223) error_file: traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html ------------------------------------------------------------ Root Cause (first observed failure): [0]: time : 2025-02-24_17:31:31 host : localhost.localdomain rank : 0 (local_rank: 0) exitcode : 1 (pid: 222) error_file: traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html ============================================================

我要发帖子