The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/lib64/python3.11/threading.py", line 1045, in _bootstrap_inner
self.run()
File "/usr/lib64/python3.11/threading.py", line 982, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 163, in do_inference
responses = self.execute(requests, config_map)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 74, in execute
return self.python_model.execute(requests, config_map)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 187, in execute
_print_component_error_log(e)
File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 55, in _print_component_error_log
raise RuntimeError(f"CANN execute error, Exception: {e}") from e
RuntimeError: CANN execute error, Exception: The Inner error is reported as above. The process exits for this inner error, and the current working operator name is Qwen25VL_VIT_graph.
Since the operator is called asynchronously, the stacktrace may be inaccurate. If you want to get the accurate stacktrace, pleace set the environment variable ASCEND_LAUNCH_BLOCKING=1.
Note: ASCEND_LAUNCH_BLOCKING=1 will force ops to run in synchronous mode, resulting in performance degradation. Please unset ASCEND_LAUNCH_BLOCKING in time after debugging.
[ERROR] 2025-08-11-19:11:20 (PID:42150, Device:2, RankID:-1) ERR00100 PTA call acl api failed.
EL0004: [PID: 42150] 2025-08-11-19:11:20.811.750 Failed to allocate memory.
Possible Cause: Available memory is insufficient.
Solution: Close applications not in use.
TraceBack (most recent call last):
rtMalloc execute failed, reason=[driver error:out of memory][FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:53]
Failed to allocate resource[DeviceMemory] with info [size:125829120]. Reason: Memory resources are exhausted.
点赞
收藏
回复
分享
举报
已解决
4块300vpro，mindie2.0运行qwen2.5-vl-32b，文本对话回复正常，但是调用图片处理接口报错内存溢出。 npuMemSize尝试改为8，20后仍然报错。
The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib64/python3.11/threading.py", line 1045, in _bootstrap_inner self.run() File "/usr/lib64/python3.11/threading.py", line 982, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 163, in do_inference responses = self.execute(requests, config_map) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 74, in execute return self.python_model.execute(requests, config_map) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 187, in execute _print_component_error_log(e) File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 55, in _print_component_error_log raise RuntimeError(f"CANN execute error, Exception: {e}") from e RuntimeError: CANN execute error, Exception: The Inner error is reported as above. The process exits for this inner error, and the current working operator name is Qwen25VL_VIT_graph. Since the operator is called asynchronously, the stacktrace may be inaccurate. If you want to get the accurate stacktrace, pleace set the environment variable ASCEND_LAUNCH_BLOCKING=1. Note: ASCEND_LAUNCH_BLOCKING=1 will force ops to run in synchronous mode, resulting in performance degradation. Please unset ASCEND_LAUNCH_BLOCKING in time after debugging. [ERROR] 2025-08-11-19:11:20 (PID:42150, Device:2, RankID:-1) ERR00100 PTA call acl api failed. EL0004: [PID: 42150] 2025-08-11-19:11:20.811.750 Failed to allocate memory. Possible Cause: Available memory is insufficient. Solution: Close applications not in use. TraceBack (most recent call last): rtMalloc execute failed, reason=[driver error:out of memory][FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:53] Failed to allocate resource[DeviceMemory] with info [size:125829120]. Reason: Memory resources are exhausted.