(base) HwHiAiUser@orangepiaipro:~$ conda activate mindnlp
(mindnlp) HwHiAiUser@orangepiaipro:~$ python download_model_by_mindnlp2.py
[WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.463.508 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclmdlBundleGetModelId failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclmdlBundleGetModelId
[WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.463.643 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclmdlBundleLoadFromMem failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclmdlBundleLoadFromMem
[WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.463.717 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclmdlBundleUnload failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclmdlBundleUnload
[WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.464.041 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclrtGetMemUceInfo failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclrtGetMemUceInfo
[WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.464.119 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclrtDeviceTaskAbort failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclrtDeviceTaskAbort
[WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.464.185 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclrtMemUceRepair failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclrtMemUceRepair
[WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.475.928 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol acltdtCleanChannel failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libacl_tdt_channel.so: undefined symbol: acltdtCleanChannel
[WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:37.599.566 [mindspore/run_check/_check_version.py:329] MindSpore version 2.4.10 and Ascend AI software package (Ascend Data Center Solution)version 7.3 does not match, the version of software package expect one of ['7.5', '7.6']. Please refer to the match info on: https://www.mindspore.cn/install
/home/HwHiAiUser/.local/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
setattr(self, word, getattr(machar, word).flat[0])
/home/HwHiAiUser/.local/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
return self._float_to_str(self.smallest_subnormal)
/home/HwHiAiUser/.local/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
setattr(self, word, getattr(machar, word).flat[0])
/home/HwHiAiUser/.local/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
return self._float_to_str(self.smallest_subnormal)
[WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:45.825.700 [mindspore/run_check/_check_version.py:347] MindSpore version 2.4.10 and "te" wheel package version 7.3 does not match. For details, refer to the installation guidelines: https://www.mindspore.cn/install
[WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:45.829.069 [mindspore/run_check/_check_version.py:354] MindSpore version 2.4.10 and "hccl" wheel package version 7.3 does not match. For details, refer to the installation guidelines: https://www.mindspore.cn/install
[WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:45.829.298 [mindspore/run_check/_check_version.py:368] Please pay attention to the above warning, countdown: 3
[WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:46.830.564 [mindspore/run_check/_check_version.py:368] Please pay attention to the above warning, countdown: 2
[WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:47.832.036 [mindspore/run_check/_check_version.py:368] Please pay attention to the above warning, countdown: 1
Building prefix dict from the default dictionary ...
Dumping model to file cache /tmp/jieba.cache
Loading model cost 2.261 seconds.
Prefix dict has been built successfully.
Sliding Window Attention is enabled but not implemented for `eager`; unexpected results may be encountered.
[WARNING] DEVICE(3677,e7ffe6286020,python):2025-02-08-02:05:41.501.430 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_memory_adapter.cc:116] Initialize] Free memory size is less than half of total memory size.Device 0 Device HBM total size:16367898624 Device HBM free size:7457329152 may be other processes occupying this card, check as: ps -ef|grep python
[WARNING] DEVICE(3677,e7ff1d22f120,python):2025-02-08-02:06:17.279.134 [mindspore/ccsrc/transform/acl_ir/op_api_convert.h:114] GetOpApiFunc] Dlsym aclSetTensorAddr failed!
Traceback (most recent call last):
File "/home/HwHiAiUser/download_model_by_mindnlp2.py", line 4, in <module>
model = AutoModel.from_pretrained('deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B')
File "/home/HwHiAiUser/.local/lib/python3.9/site-packages/mindnlp/transformers/models/auto/auto_factory.py", line 510, in from_pretrained
return model_class.from_pretrained(
File "/home/HwHiAiUser/.local/lib/python3.9/site-packages/mindnlp/transformers/modeling_utils.py", line 3025, in from_pretrained
) = cls._load_pretrained_model(
File "/home/HwHiAiUser/.local/lib/python3.9/site-packages/mindnlp/transformers/modeling_utils.py", line 3414, in _load_pretrained_model
raise RuntimeError(f"Error(s) in loading state_dict for {model.__class__.__name__}:\n\t{error_msg}")
RuntimeError: Error(s) in loading state_dict for Qwen2Model:
While copying the parameter named "model.layers.0.input_layernorm.weight", whose dimensions in the model are (1536,) and whose dimensions in the checkpoint are (1536,), an exception occurred : ('aclSetTensorAddr is nullptr\n\n----------------------------------------------------\n- C++ Call Stack: (For framework developers)\n----------------------------------------------------\nmindspore/ccsrc/transform/acl_ir/op_api_convert.h:947 UpdateAddress\n',).
(mindnlp) HwHiAiUser@orangepiaipro:~$
设备:香橙派AI pro 16G 8T
CANN环境:8.0.RC2.alpha003
mindnlp测试代码:
from mindnlp.transformers import AutoModel #model = AutoModel.from_pretrained('bert-base-cased') model = AutoModel.from_pretrained('deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B')mindnlp版本:0.4.0
执行结果:
python xxx.py
(base) HwHiAiUser@orangepiaipro:~$ conda activate mindnlp (mindnlp) HwHiAiUser@orangepiaipro:~$ python download_model_by_mindnlp2.py [WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.463.508 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclmdlBundleGetModelId failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclmdlBundleGetModelId [WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.463.643 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclmdlBundleLoadFromMem failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclmdlBundleLoadFromMem [WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.463.717 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclmdlBundleUnload failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclmdlBundleUnload [WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.464.041 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclrtGetMemUceInfo failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclrtGetMemUceInfo [WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.464.119 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclrtDeviceTaskAbort failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclrtDeviceTaskAbort [WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.464.185 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol aclrtMemUceRepair failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libascendcl.so: undefined symbol: aclrtMemUceRepair [WARNING] GE_ADPT(3677,e7ffe6286020,python):2025-02-08-02:04:35.475.928 [mindspore/ccsrc/utils/dlopen_macro.h:163] DlsymAscend] Dynamically load symbol acltdtCleanChannel failed, result = /usr/local/Ascend/ascend-toolkit/latest/lib64/libacl_tdt_channel.so: undefined symbol: acltdtCleanChannel [WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:37.599.566 [mindspore/run_check/_check_version.py:329] MindSpore version 2.4.10 and Ascend AI software package (Ascend Data Center Solution)version 7.3 does not match, the version of software package expect one of ['7.5', '7.6']. Please refer to the match info on: https://www.mindspore.cn/install /home/HwHiAiUser/.local/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero. setattr(self, word, getattr(machar, word).flat[0]) /home/HwHiAiUser/.local/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero. return self._float_to_str(self.smallest_subnormal) /home/HwHiAiUser/.local/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero. setattr(self, word, getattr(machar, word).flat[0]) /home/HwHiAiUser/.local/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero. return self._float_to_str(self.smallest_subnormal) [WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:45.825.700 [mindspore/run_check/_check_version.py:347] MindSpore version 2.4.10 and "te" wheel package version 7.3 does not match. For details, refer to the installation guidelines: https://www.mindspore.cn/install [WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:45.829.069 [mindspore/run_check/_check_version.py:354] MindSpore version 2.4.10 and "hccl" wheel package version 7.3 does not match. For details, refer to the installation guidelines: https://www.mindspore.cn/install [WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:45.829.298 [mindspore/run_check/_check_version.py:368] Please pay attention to the above warning, countdown: 3 [WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:46.830.564 [mindspore/run_check/_check_version.py:368] Please pay attention to the above warning, countdown: 2 [WARNING] ME(3677:255086264082464,MainProcess):2025-02-08-02:04:47.832.036 [mindspore/run_check/_check_version.py:368] Please pay attention to the above warning, countdown: 1 Building prefix dict from the default dictionary ... Dumping model to file cache /tmp/jieba.cache Loading model cost 2.261 seconds. Prefix dict has been built successfully. Sliding Window Attention is enabled but not implemented for `eager`; unexpected results may be encountered. [WARNING] DEVICE(3677,e7ffe6286020,python):2025-02-08-02:05:41.501.430 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_memory_adapter.cc:116] Initialize] Free memory size is less than half of total memory size.Device 0 Device HBM total size:16367898624 Device HBM free size:7457329152 may be other processes occupying this card, check as: ps -ef|grep python [WARNING] DEVICE(3677,e7ff1d22f120,python):2025-02-08-02:06:17.279.134 [mindspore/ccsrc/transform/acl_ir/op_api_convert.h:114] GetOpApiFunc] Dlsym aclSetTensorAddr failed! Traceback (most recent call last): File "/home/HwHiAiUser/download_model_by_mindnlp2.py", line 4, in <module> model = AutoModel.from_pretrained('deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B') File "/home/HwHiAiUser/.local/lib/python3.9/site-packages/mindnlp/transformers/models/auto/auto_factory.py", line 510, in from_pretrained return model_class.from_pretrained( File "/home/HwHiAiUser/.local/lib/python3.9/site-packages/mindnlp/transformers/modeling_utils.py", line 3025, in from_pretrained ) = cls._load_pretrained_model( File "/home/HwHiAiUser/.local/lib/python3.9/site-packages/mindnlp/transformers/modeling_utils.py", line 3414, in _load_pretrained_model raise RuntimeError(f"Error(s) in loading state_dict for {model.__class__.__name__}:\n\t{error_msg}") RuntimeError: Error(s) in loading state_dict for Qwen2Model: While copying the parameter named "model.layers.0.input_layernorm.weight", whose dimensions in the model are (1536,) and whose dimensions in the checkpoint are (1536,), an exception occurred : ('aclSetTensorAddr is nullptr\n\n----------------------------------------------------\n- C++ Call Stack: (For framework developers)\n----------------------------------------------------\nmindspore/ccsrc/transform/acl_ir/op_api_convert.h:947 UpdateAddress\n',). (mindnlp) HwHiAiUser@orangepiaipro:~$