NPU驱动问题
收藏回复举报
NPU驱动问题
t('forum.solved') 已解决
发表于2025-03-25 15:11:38
0 查看

[EVENT] PROFILING(22782,python):2025-03-25-15:06:28.817.468 [msprof_callback_impl.cpp:324] >>> (tid:22782) Started to register profiling ctrl callback.

[EVENT] PROFILING(22782,python):2025-03-25-15:06:28.817.769 [msprof_callback_impl.cpp:331] >>> (tid:22782) Started to register profiling hash id callback.

[EVENT] PROFILING(22782,python):2025-03-25-15:06:28.817.808 [prof_atls_plugin.cpp:83] >>> (tid:22782) RegisterProfileCallback, callback type is 7

[EVENT] PROFILING(22782,python):2025-03-25-15:06:28.817.830 [msprof_callback_impl.cpp:338] >>> (tid:22782) Started to register profiling enable host freq callback.

[EVENT] PROFILING(22782,python):2025-03-25-15:06:28.817.849 [prof_atls_plugin.cpp:83] >>> (tid:22782) RegisterProfileCallback, callback type is 8

[EVENT] PROFILING(22782,python):2025-03-25-15:06:28.916.136 [prof_atls_plugin.cpp:160] >>> (tid:22782) Module[6] register callback of ctrl handle.

ASCEND_TOOLKIT_PATH: None

ASCEND_SLOG_PRINT_TO_STDOUT: None

[EVENT] ASCENDCL(22782,python):2025-03-25-15:06:35.039.061 [acl_resource_manager.cpp:90]22782 GetRuntimeV2Env: runtime v2 flag : model flag = 1, singleOp flag = 1

[EVENT] PROFILING(22782,python):2025-03-25-15:06:35.055.209 [prof_atls_plugin.cpp:160] >>> (tid:22782) Module[48] register callback of ctrl handle.

[EVENT] PROFILING(22782,python):2025-03-25-15:06:35.055.358 [prof_atls_plugin.cpp:160] >>> (tid:22782) Module[45] register callback of ctrl handle.

[EVENT] PROFILING(22782,python):2025-03-25-15:06:35.624.926 [msprof_callback_impl.cpp:79] >>> (tid:22782) MsprofCtrlCallback called, type: 255

[EVENT] PROFILING(22782,python):2025-03-25-15:06:35.625.469 [ai_drv_dev_api.cpp:333] >>> (tid:22782) Succeeded to DrvGetApiVersion version: 0x72313

[EVENT] RUNTIME(22782,python):2025-03-25-15:06:35.625.688 [runtime.cc:4393] 22782 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set

[EVENT] PROFILING(22782,python):2025-03-25-15:06:35.628.160 [prof_atls_plugin.cpp:160] >>> (tid:22782) Module[7] register callback of ctrl handle.

ACL 初始化成功

[EVENT] TDT(22782,python):2025-03-25-15:06:35.628.597 [thread_mode_manager.cpp:34][Open][tid:22782] [ThreadModeManager] enter into open process deviceId[0] rankSize[0]

[EVENT] TDT(22782,python):2025-03-25-15:06:35.629.175 [thread_mode_manager.cpp:217][HandleAICPUPackage][tid:22782] begin load aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/] file[Ascend-aicpu_syskernels.tar.gz]

[EVENT] TDT(22782,python):2025-03-25-15:06:35.629.259 [package_worker.cpp:349][LoadAICPUPackageForThreadMode][tid:22782] Package checkcode is [49484690]

[EVENT] TDT(22782,python):2025-03-25-15:06:35.629.295 [package_worker.cpp:353][LoadAICPUPackageForThreadMode][tid:22782] Open aicpu_package_install.info verifileFile[/home/HwHiAiUser/aicpu_package_install.info], strerror[File exists]

[EVENT] TDT(22782,python):2025-03-25-15:06:35.635.441 [thread_mode_manager.cpp:114][SetAICPUProfilingCallback][tid:22782] [ThreadModeManager] profiling callback is nullptr, skip set aicpu profiling callback

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.635.562 [aicpusd_interface_process.cpp:525][TryGetLogLevelFromParentProcess][tid:22782] get ASCEND_GLOBAL_LOG_LEVEL [] and ASCEND_GLOBAL_EVENT_ENABLE []

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.635.826 [aicpusd_interface_process.cpp:467][GetCurrentRunMode][tid:22782] Current aicpu mode is offline (call by api).

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.635.875 [aicpusd_drv_manager.cpp:327][MarkMdc][tid:22782] Get hardware version[7] success.

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.635.909 [aicpusd_drv_manager.cpp:190][GetNormalAicpuInfo][tid:22782] aicpuBitMap[8], aicpuNum[1].

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.635.936 [aicpusd_drv_manager.cpp:224][GetCcpuInfo][tid:22782] ccpuBitMap[7].

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.635.983 [aicpusd_drv_manager.cpp:110][GetNormalAicpuDCpuInfo][tid:22782] GetNormalAicpuDCpuInfo, deviceId[0], aicpu_num[1], aicpu_os_sched[281470681743361], ccpu_num[255082402676739], ccpu_os_sched[255082402676737], dcpu_num[255082402676736], dcpu_os_sched[281470681743361], tscpu_num[187647121162240], tscpu_os_sched[0].

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.636.009 [aicpusd_drv_manager.cpp:306][InitDrvMgrCaluniqueVfId][tid:22782] InitDrvMgr uniqueVfId=0, deviceId=0

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.636.028 [aicpusd_drv_manager.cpp:377][InitDrvMgr][tid:22782] host pid[22782], host proc name[], vf id[0], first aicpu index[0], aicpu num[1], dcpu base index[3], dcpu num[0].

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.636.209 [aicpusd_resource_manager.cpp:257][InitBufManager][tid:22782] Aicpu schedule SetBuffCfg successed!

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.636.598 [aicpusd_worker.cpp:74][ThreadPool][tid:22782] ThreadPool

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.636.818 [aicpusd_worker.cpp:274][AddPidToTask][tid:22805] Bind pid by hal.

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.636.872 [aicpusd_worker.cpp:276][AddPidToTask][tid:22805] AddPidToTask by halBindCgroup

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.654.859 [aicpusd_worker.cpp:323][SetAffinityBySelf][tid:22805] [hw]SetAffinityBySelf, physIndex[3], devNum[0]

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.654.991 [aicpusd_worker.cpp:389][SetAffinity][tid:22805] aicpu bind tid by self, index[0], deviceId[0], res[0].

[EVENT] CCECPU(22782,python):2025-03-25-15:06:35.655.312 [aicpusd_cust_so_manager.cpp:77][InitAicpuCustSoManager][tid:22782] cust so dir name is /home/HwHiAiUser/cust_aicpu_0_0_22782/.

[EVENT] RUNTIME(22782,python):2025-03-25-15:06:35.660.243 [device.cc:341] 22782 Init: isDoubledie:0, topologytype:0

[EVENT] DRV(22782,python):2025-03-25-15:06:35.660.589 [grp_mng.c:81][bufmng] [halGrpCreate 81] Create grp. (grp_name=private_buff_grp_22782; grp_id=10; max_size=0; cache_flag=0)

[EVENT] DRV(22782,python):2025-03-25-15:06:35.660.656 [grp_mng.c:144][bufmng] [halGrpAddProc 144] add grp succ, name:private_buff_grp_22782, pid:22782, grp_id:10, admin:1 alloc:1 read:1 write:1

[EVENT] DRV(22782,python):2025-03-25-15:06:35.660.837 [buff_recycle.c:758][bufmng] [procMngInit 758] poolId 10 add task node uid 11 pid 22782

[EVENT] DRV(22782,python):2025-03-25-15:06:35.660.874 [drv_buff_mbuf.c:65][bufmng] [mbufSetPrivFlag 65] Set mbuf priv flag sucess. (flag=0, g_mbuf_priv_flag=0)

[EVENT] DRV(22782,python):2025-03-25-15:06:35.660.899 [grp_mng.c:212][bufmng] [halGrpAttach 212] grp attach, grp_name:private_buff_grp_22782, grp_id:10, timeout:1000

[EVENT] DRV(22782,python):2025-03-25-15:06:35.660.926 [drv_buff_memzone.c:450][bufmng] [memzone_cfg 450] BuffCfg success. (cfg num=4; huge_prior=393216; normal=393216; huge_only=393216; dvpp_huge_prior=393216; dvpp_normal=393216; dvpp_huge_only=393216)

[EVENT] TDT(22782,python):2025-03-25-15:06:35.663.188 [tsd_client.cpp:175][TsdCapabilityGet][tid:22782] TsdCapabilityGet Begin.

[EVENT] RUNTIME(22782,python):2025-03-25-15:06:35.665.239 [npu_driver.cc:5320] 22808 GetDeviceStatus: GetDeviceStatus status=1.

[EVENT] TDT(22782,python):2025-03-25-15:06:35.665.861 [client_manager.cpp:157][SetProfilingCallback][tid:22782] [TsdClient] set profiling callback success

设备设置成功

上下文创建成功

流创建成功

[EVENT] ASCENDCL(22782,python):2025-03-25-15:06:35.680.987 [acl_resource_manager.cpp:90]22782 GetRuntimeV2Env: runtime v2 flag : model flag = 1, singleOp flag = 1

[ERROR] acl init failed

[INFO] open device 0 success

[ERROR] GE(22782,python):2025-03-25-15:06:35.790.563 [model_utils.cc:1299]22782 GetHbmFeatureMapMemInfo: ErrorNo: 4294967295(failed) [LOAD][DEFAULT]Assert (sub_memory_info.size() == 3U) failed, expect 3 actual 4

[ERROR] GE(22782,python):2025-03-25-15:06:35.790.697 [model_utils.cc:1314]22782 GetAllMemoryTypeSize: ErrorNo: 4294967295(failed) [LOAD][DEFAULT]Assert ((GetHbmFeatureMapMemInfo(ge_model, all_mem_info)) == ge::SUCCESS) failed

[ERROR] GE(22782,python):2025-03-25-15:06:35.790.965 [model_utils.cc:1272]22782 InitRuntimeParams: ErrorNo: 4294967295(failed) [LOAD][DEFAULT]Assert (total_hbm_size == (static_cast<int64_t>(runtime_param.mem_size) - runtime_param.zero_copy_size)) failed, expect 16385024 actual 0

[ERROR] GE(22782,python):2025-03-25-15:06:35.791.013 [davinci_model.cc:451]22782 InitRuntimeParams: ErrorNo: 4294967295(failed) [LOAD][DEFAULT]Assert ((ModelUtils::InitRuntimeParams(ge_model_, runtime_param_, device_id_)) == ge::SUCCESS) failed

[ERROR] GE(22782,python):2025-03-25-15:06:35.791.051 [davinci_model.cc:640]22782 Init: ErrorNo: 4294967295(failed) [LOAD][DEFAULT]Assert ((InitRuntimeParams()) == ge::SUCCESS) failed

[ERROR] GE(22782,python):2025-03-25-15:06:35.791.078 [model_manager.cc:1203]22782 LoadModelOffline: ErrorNo: 4294967295(failed) [LOAD][DEFAULT][Init][DavinciModel] failed, ret:1343225857.

[ERROR] GE(22782,python):2025-03-25-15:06:35.797.796 [graph_loader.cc:143]22782 LoadModelFromData: ErrorNo: 1343225857(Parameter's invalid!) [LOAD][DEFAULT][Load][Model] failed, model_id:1.

[ERROR] ASCENDCL(22782,python):2025-03-25-15:06:35.797.932 [model.cpp:280]22782 ModelLoadFromFileWithMem: [LOAD][DEFAULT][Model][FromData]load model from data failed, ge result[1343225857]

[ERROR] ASCENDCL(22782,python):2025-03-25-15:06:35.804.455 [model.cpp:1628]22782 aclmdlLoadFromFile: [LOAD][DEFAULT]Load model from file failed!

[ERROR] load model from file failed, model file is yolov8v_NPU.om

[WARN] Check failed:processModel->LoadModelFromFile(modelPath), ret:1

[WARN] no model had been loaded, unload failed

模型加载失败,错误信息:[1][ACL: invalid parameter]

Traceback (most recent call last):

  File "/home/HwHiAiUser/Desktop/YOLOV8/Photo_Detect.py", line 141, in <module>

    center_points = detect("bus.jpg")

  File "/home/HwHiAiUser/Desktop/YOLOV8/Photo_Detect.py", line 132, in detect

    center_points = process_frame(frame)

  File "/home/HwHiAiUser/Desktop/YOLOV8/Photo_Detect.py", line 69, in process_frame

    init_acl()

  File "/home/HwHiAiUser/Desktop/YOLOV8/Photo_Detect.py", line 59, in init_acl

    model = InferSession(device_id=device_id, model_path=model_path)

  File "/usr/local/lib/python3.9/site-packages/ais_bench/infer/interface.py", line 26, in __init__

    self.session = aclruntime.InferenceSession(self.model_path, self.device_id, options)

RuntimeError: [1][ACL: invalid parameter]

[EVENT] CCECPU(22782,python):2025-03-25-15:06:36.828.270 [aicpusd_worker.cpp:168][WaitForStop][tid:22782] WaitForStop begin.

[EVENT] CCECPU(22782,python):2025-03-25-15:06:38.870.896 [aicpusd_worker.cpp:174][WaitForStop][tid:22782] WaitForStop end.

[EVENT] CCECPU(22782,python):2025-03-25-15:06:38.872.149 [aicpusd_mpi_mgr.cpp:48][PrintStatisticInfo][tid:22782] Mpi Dvpp event statistic: [0]

[EVENT] RUNTIME(22782,python):2025-03-25-15:06:39.324.274 [runtime.cc:1699] 22782 ~Runtime: deconstruct runtime.
这个报错是我模型转换有问题还是ACL有问题?om我在20T跑过可以用,但是转移到8T上就跑不了了。

我要发帖子