1、atc转模型时设置fp32、高精度推理。精度依旧不达标;
之前适配过Atlas 300IPro卡,推理精度没问题。之前适配环境是6.0.1,刚开始适配是环境也是6.0.1,因为精度达不到升级到8.0.1
-----------------------------------------------------------------------------------
BIOS Vendor ID: HiSilicon
BIOS Model name: HUAWEI Kunpeng 920 5220
-----------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------+
| npu-smi 24.1.0 Version: 24.1.0 |
+-------------------------------+-----------------+------------------------------------------------------+
| NPU Name | Health | Power(W) Temp(C) Hugepages-Usage(page) |
| Chip Device | Bus-Id | AICore(%) Memory-Usage(MB) |
+===============================+=================+======================================================+
| 3 310 | OK | 12.8 54 0 / 969 |
| 0 0 | 0000:0A:00.0 | 0 630 / 7759 |
+-------------------------------+-----------------+------------------------------------------------------+
| 3 310 | OK | 12.8 51 0 / 969 |
| 1 1 | 0000:0B:00.0 | 0 631 / 7759 |
+-------------------------------+-----------------+------------------------------------------------------+
| 3 310 | OK | 12.8 52 0 / 969 |
| 2 2 | 0000:0C:00.0 | 0 649 / 7759 |
+-------------------------------+-----------------+------------------------------------------------------+
| 3 310 | OK | 12.8 49 0 / 969 |
| 3 3 | 0000:0D:00.0 | 0 628 / 7759 |
+===============================+=================+======================================================+
+-------------------------------+-----------------+------------------------------------------------------+
| NPU Chip | Process id | Process name | Process memory(MB) |
+===============================+=================+======================================================+
| No running processes found in NPU 3 |
+===============================+=================+======================================================+
-----------------------------------------------------------------------------------
昇腾卡转模型工具:Ascend-cann-toolkit_8.0.1_linux-x86_64.run
推理:Ascend-cann-nnrt_8.0.1_linux-aarch64.run
尝试过的方案:
1、atc转模型时设置fp32、高精度推理。精度依旧不达标;
2、服务器重启,再测试 结果推理结果有变化。
自研模型,都是常规算子。
之前适配过Atlas 300IPro卡,推理精度没问题。之前适配环境是6.0.1,刚开始适配是环境也是6.0.1,因为精度达不到升级到8.0.1
-----------------------------------------------------------------------------------
环境:
架构: aarch64
CPU 运行模式: 64-bit
字节序: Little Endian
CPU: 64
在线 CPU 列表: 0-63
每个核的线程数: 1
每个座的核数: 32
座: 2
NUMA 节点: 2
厂商 ID: HiSilicon
BIOS Vendor ID: HiSilicon
型号: 0
型号名称: Kunpeng-920
BIOS Model name: HUAWEI Kunpeng 920 5220
-----------------------------------------------------------------------------------
驱动:
npu-smi info
+--------------------------------------------------------------------------------------------------------+
| npu-smi 24.1.0 Version: 24.1.0 |
+-------------------------------+-----------------+------------------------------------------------------+
| NPU Name | Health | Power(W) Temp(C) Hugepages-Usage(page) |
| Chip Device | Bus-Id | AICore(%) Memory-Usage(MB) |
+===============================+=================+======================================================+
| 3 310 | OK | 12.8 54 0 / 969 |
| 0 0 | 0000:0A:00.0 | 0 630 / 7759 |
+-------------------------------+-----------------+------------------------------------------------------+
| 3 310 | OK | 12.8 51 0 / 969 |
| 1 1 | 0000:0B:00.0 | 0 631 / 7759 |
+-------------------------------+-----------------+------------------------------------------------------+
| 3 310 | OK | 12.8 52 0 / 969 |
| 2 2 | 0000:0C:00.0 | 0 649 / 7759 |
+-------------------------------+-----------------+------------------------------------------------------+
| 3 310 | OK | 12.8 49 0 / 969 |
| 3 3 | 0000:0D:00.0 | 0 628 / 7759 |
+===============================+=================+======================================================+
+-------------------------------+-----------------+------------------------------------------------------+
| NPU Chip | Process id | Process name | Process memory(MB) |
+===============================+=================+======================================================+
| No running processes found in NPU 3 |
+===============================+=================+======================================================+
-----------------------------------------------------------------------------------
昇腾卡转模型工具:Ascend-cann-toolkit_8.0.1_linux-x86_64.run
推理:Ascend-cann-nnrt_8.0.1_linux-aarch64.run