系统环境:

# lsb_release -a
No LSB modules are available.
Distributor ID:    Ubuntu
Description:    Ubuntu 20.04.6 LTS
Release:    20.04
Codename:    focal

内核版本:

# uname -rvm
5.4.0-110-generic #124-Ubuntu SMP Thu Apr 14 19:46:19 UTC 2022 x86_64

驱动版本:

# npu-smi info
+------------------------------------------------------------------------------------------------+
| npu-smi 22.0.2                           Version: 22.0.2                                       |
+-----------------------+-----------------+------------------------------------------------------+
| NPU     Name          | Health          | Power(W)     Temp(C)           Hugepages-Usage(page) |
| Chip    Device        | Bus-Id          | AICore(%)    Memory-Usage(MB)                        |
+=======================+=================+======================================================+
| 0       310           | OK              | 12.8         52                2200 / 2200           |
| 0       0             | 0000:01:00.0    | 100          5834 / 7764                             |
+=======================+=================+======================================================+

调查方式

通过内核 hungtask 机制,使内核在 hung 住之后可以自动触发 kernel panic, 进一步触发提前配置好的 coredump, 抓取内核 hang 住之后的日志信息.

关键日志

[  243.186984] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.186990] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.186996] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187003] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187011] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187017] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187024] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187034] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187040] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187050] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187056] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187064] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187074] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187079] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187088] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187093] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187099] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187106] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187112] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187117] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187123] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187128] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187134] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187140] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187149] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187154] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187160] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187165] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187172] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187178] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187184] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187192] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187199] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187205] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187212] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187217] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187223] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187235] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187241] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187250] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187260] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187266] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187280] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187285] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187293] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187300] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187306] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187314] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187321] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187333] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187339] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187344] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187356] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187362] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187368] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187375] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187381] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187386] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187394] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187399] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187405] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187417] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187422] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187428] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187436] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187443] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187450] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187460] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187465] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187472] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187477] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187483] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187488] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187494] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187499] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187505] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187516] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187524] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187529] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187539] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187546] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187553] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187564] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187570] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187578] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187587] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187595] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187606] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187612] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187623] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187628] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187634] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187643] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187648] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187654] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187659] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187665] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187670] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187676] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187682] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187687] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187693] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187700] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187707] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187713] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187724] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187730] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187738] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187744] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187750] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <RT_RECV:1574> invalid dev_status=4 devid=0
[  243.187869] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.187954] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188007] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188052] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188098] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188140] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188183] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188236] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188277] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188313] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188352] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188401] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188457] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188498] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188542] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188583] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188623] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188660] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188701] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188743] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188779] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188822] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188866] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188912] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.188985] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189033] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189074] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189114] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189154] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189195] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189236] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189272] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189319] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189361] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189406] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189444] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189487] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189527] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189567] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189609] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189650] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189690] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189730] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189769] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189805] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189843] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189889] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189927] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.189968] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190017] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190064] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190107] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190148] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190189] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190229] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190268] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190309] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190356] [ascend] [ERROR] [tsdrv] [devdrv_ioctl 849] <AclVDecReportTh:1574> invalid dev_status=4 devid=0
[  243.190357]  add_transaction_credits+0xeb/0x2e0
[  243.190358]  ? ext4_do_update_inode+0x5f2/0x7f0
[  243.190359]  ? jbd2_journal_get_write_access+0x3c/0x90
[  243.190360]  start_this_handle+0xff/0x450
[  243.190362]  ? _cond_resched+0x19/0x30
[  243.190363]  ? kmem_cache_alloc+0x178/0x230
[  243.190364]  jbd2__journal_start+0xee/0x200
[  243.190365]  ? ext4_dirty_inode+0x33/0x70
[  243.190377]  __ext4_journal_start_sb+0x69/0x120
[  243.190378]  ext4_dirty_inode+0x33/0x70
[  243.190380]  __mark_inode_dirty+0x1bb/0x360
[  243.190381]  generic_update_time+0x9d/0xc0
[  243.190382]  file_update_time+0xeb/0x140
[  243.190383]  ? try_to_wake_up+0x229/0x650
[  243.190385]  __generic_file_write_iter+0x9a/0x1d0
[  243.190398]  ext4_file_write_iter+0xb9/0x360
[  243.190400]  new_sync_write+0x125/0x1c0
[  243.190402]  __vfs_write+0x29/0x40
[  243.190403]  vfs_write+0xb9/0x1a0
[  243.190404]  ksys_write+0x67/0xe0
[  243.190404]  __x64_sys_write+0x1a/0x20
[  243.190406]  do_syscall_64+0x57/0x190
[  243.190417]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  243.190418] RIP: 0033:0x55eba8f69c7b
[  243.190420] Code: Bad RIP value.
[  243.190420] RSP: 002b:000000c000e60b70 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[  243.190422] RAX: ffffffffffffffda RBX: 000000c000063000 RCX: 000055eba8f69c7b
[  243.190422] RDX: 00000000000001b3 RSI: 000000c000bac700 RDI: 0000000000000020
[  243.190422] RBP: 000000c000e60bc0 R08: 0000000000000001 R09: 000000c000e2a1e0
[  243.190423] R10: 00000000000001b3 R11: 0000000000000202 R12: 000000c000e60c50
[  243.190423] R13: 0000000000000000 R14: 000000c000bcad00 R15: ffffffffffffffff
[  243.190466] INFO: task vgTP_DevEng:1595 blocked for more than 120 seconds.
[  243.190467]       Tainted: P           OE     5.4.0-110-generic #124-Ubuntu
[  243.190467] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  243.190474] vgTP_DevEng     D    0  1595   1507 0x00000000
[  243.190475] Call Trace:
[  243.190476]  __schedule+0x2e3/0x740
[  243.190478]  schedule+0x42/0xb0
[  243.190479]  blk_queue_enter+0x160/0x200
[  243.190480]  ? __wake_up_pollfree+0x40/0x40
[  243.190481]  generic_make_request+0x94/0x320
[  243.190482]  submit_bio+0x48/0x1d0
[  243.190483]  ? bio_add_page+0x3b/0x90
[  243.190484]  ext4_mpage_readpages+0x476/0xac0
[  243.190485]  ext4_readpages+0x3a/0x40
[  243.190486]  read_pages+0x71/0x1a0
[  243.190488]  __do_page_cache_readahead+0x180/0x1a0
[  243.190489]  ondemand_readahead+0x192/0x2d0
[  243.190490]  page_cache_async_readahead+0xb5/0xe0
[  243.190491]  filemap_fault+0x425/0xa50
[  243.190495]  ? unlock_page_memcg+0x12/0x20
[  243.190496]  ? filemap_map_pages+0x24c/0x380
[  243.190497]  ext4_filemap_fault+0x32/0x50
[  243.190498]  __do_fault+0x3c/0x130
[  243.190499]  do_fault+0x24b/0x640
[  243.190500]  __handle_mm_fault+0x4c5/0x7a0
[  243.190501]  handle_mm_fault+0xca/0x200
[  243.190502]  do_user_addr_fault+0x1f9/0x450
[  243.190503]  __do_page_fault+0x58/0x90
[  243.190504]  do_page_fault+0x2c/0xe0
[  243.190505]  page_fault+0x34/0x40
[  243.190506] RIP: 0033:0x7fcc4e19cbc9
[  243.190507] Code: d9 48 39 d1 0f 87 78 fd ff ff 48 83 ef 01 48 63 0c f8 48 01 d9 48 39 d1 0f 86 e8 00 00 00 48 39 fe 73 33 48 8d 0c 3e 48 d1 e9 <4c> 63 04 c8 49 01 d8 49 39 d0 76 31 48 39 ce 73 1b 4c 8d 04 0e 49
[  243.190507] RSP: 002b:00007fcc1c3f1ba0 EFLAGS: 00010203
[  243.190508] RAX: 00007fcc4e884f88 RBX: 00007fcc4e884f7c RCX: 00000000000005f4
[  243.190508] RDX: 00007fcc4e7fe6de RSI: 00000000000003f9 RDI: 00000000000007f0
[  243.190508] RBP: 00007fcc1c3f1ce0 R08: 00007fcc4e7f75b0 R09: 00007fcc4eaba260
[  243.190509] R10: 00007fcc1c3f1bb8 R11: 00007fcc4e8b9980 R12: 0000000000000003
[  243.190509] R13: 00007fcc4e884f84 R14: 00007fcc4e741000 R15: 0000000000000001
[  243.190521] INFO: task vgTP_DevEng:1600 blocked for more than 120 seconds.
[  243.190522]       Tainted: P           OE     5.4.0-110-generic #124-Ubuntu
[  243.190522] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  243.190522] vgTP_DevEng     D    0  1600   1507 0x00000000
[  243.190523] Call Trace:
[  243.190524]  __schedule+0x2e3/0x740
[  243.190525]  schedule+0x42/0xb0
[  243.190526]  blk_queue_enter+0x160/0x200
[  243.190527]  ? __wake_up_pollfree+0x40/0x40
[  243.190528]  generic_make_request+0x94/0x320
[  243.190529]  submit_bio+0x48/0x1d0
[  243.190529]  ? bio_add_page+0x3b/0x90
[  243.190530]  ext4_mpage_readpages+0x476/0xac0
[  243.190532]  ext4_readpages+0x3a/0x40
[  243.190533]  read_pages+0x71/0x1a0
[  243.190538]  __do_page_cache_readahead+0x180/0x1a0
[  243.190539]  filemap_fault+0x697/0xa50
[  243.190540]  ? unlock_page_memcg+0x12/0x20
[  243.190542]  ? page_add_file_rmap+0xff/0x1a0
[  243.190543]  ? filemap_map_pages+0x24c/0x380
[  243.190544]  ext4_filemap_fault+0x32/0x50
[  243.190544]  __do_fault+0x3c/0x130
[  243.190545]  do_fault+0x24b/0x640
[  243.190546]  __handle_mm_fault+0x4c5/0x7a0
[  243.190547]  handle_mm_fault+0xca/0x200
[  243.190548]  do_user_addr_fault+0x1f9/0x450
[  243.190549]  __do_page_fault+0x58/0x90
[  243.190550]  do_page_fault+0x2c/0xe0
[  243.190551]  page_fault+0x34/0x40
[  243.190555] RIP: 0033:0x7fcc5c284fb0
[  243.190561] Code: Bad RIP value.
[  243.190562] RSP: 002b:00007fcc195efcf8 EFLAGS: 00010202
[  243.190563] RAX: 0000000000000654 RBX: 00007fcc195effe0 RCX: 0000000000000000
[  243.190564] RDX: 000000000000005b RSI: 00007fcc195efdb0 RDI: 00007fcc195efd30
[  243.190564] RBP: 00007fcc195efe10 R08: 0000000000000001 R09: 0000000000000001
[  243.190565] R10: 0000000000000076 R11: 00007fcc5c284fb0 R12: 00007fcc195efdb0
[  243.190565] R13: 00007fcc195efd50 R14: 00007fcc195efd30 R15: 00007fcc195eff20
[  243.190576] NMI backtrace for cpu 3
[  243.190577] CPU: 3 PID: 36 Comm: khungtaskd Kdump: loaded Tainted: P           OE     5.4.0-110-generic #124-Ubuntu
[  243.190578] Hardware name: Deepglint Face Comparison Host Device (standard)/DG-ATX, BIOS 1.5 10/05/2020
[  243.190578] Call Trace:
[  243.190579]  dump_stack+0x6d/0x8b
[  243.190581]  ? lapic_can_unplug_cpu+0x80/0x80
[  243.190582]  nmi_cpu_backtrace.cold+0x14/0x53
[  243.190599]  nmi_trigger_cpumask_backtrace+0xe8/0xf0
[  243.190600]  arch_trigger_cpumask_backtrace+0x19/0x20
[  243.190601]  watchdog+0x32e/0x390
[  243.190603]  kthread+0x104/0x140
[  243.190603]  ? hungtask_pm_notify+0x40/0x40
[  243.190604]  ? kthread_park+0x90/0x90
[  243.190605]  ret_from_fork+0x35/0x40
[  243.190606] Sending NMI from CPU 3 to CPUs 0-2:
[  243.190641] NMI backtrace for cpu 2
[  243.190642] CPU: 2 PID: 582 Comm: kworker/2:4 Kdump: loaded Tainted: P           OE     5.4.0-110-generic #124-Ubuntu
[  243.190642] Hardware name: Deepglint Face Comparison Host Device (standard)/DG-ATX, BIOS 1.5 10/05/2020
[  243.190642] Workqueue: events drm_fb_helper_dirty_work [drm_kms_helper]
[  243.190643] RIP: 0010:memcpy_erms+0x6/0x10
[  243.190643] Code: ff 90 90 90 eb 1e 0f 1f 00 48 89 f8 48 89 d1 48 c1 e9 03 83 e2 07 f3 48 a5 89 d1 f3 a4 c3 66 0f 1f 44 00 00 48 89 f8 48 89 d1 <f3> a4 c3 0f 1f 80 00 00 00 00 48 89 f8 48 83 fa 20 72 7e 40 38 fe
[  243.190643] RSP: 0018:ffff9cfe4071fe18 EFLAGS: 00010246
[  243.190644] RAX: ffff9cfe68ce8400 RBX: ffff888ec84968d0 RCX: 0000000000000160
[  243.190644] RDX: 0000000000001e00 RSI: ffff9cfe4c58d0a0 RDI: ffff9cfe68cea0a0
[  243.190644] RBP: ffff9cfe4071fe60 R08: 0000000000000000 R09: ffff9cfe4071fc00
[  243.190644] R10: ffff888eb8900e00 R11: ffff888d400eff00 R12: ffff9cfe68ce8400
[  243.190644] R13: 000000000000029e R14: ffff9cfe4c58b400 R15: 0000000000001e00
[  243.190645] FS:  0000000000000000(0000) GS:ffff888eceb00000(0000) knlGS:0000000000000000
[  243.190645] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  243.190645] CR2: 00007fcc5d7ce000 CR3: 000000074beb6001 CR4: 00000000003606e0
[  243.190645] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  243.190645] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  243.190646] Call Trace:
[  243.190646]  ? drm_fb_helper_dirty_work+0x110/0x1b0 [drm_kms_helper]
[  243.190646]  process_one_work+0x1eb/0x3b0
[  243.190646]  worker_thread+0x4d/0x400
[  243.190646]  kthread+0x104/0x140
[  243.190646]  ? process_one_work+0x3b0/0x3b0
[  243.190647]  ? kthread_park+0x90/0x90
[  243.190647]  ret_from_fork+0x35/0x40
[  243.191597] NMI backtrace for cpu 0
[  243.191598] CPU: 0 PID: 1748 Comm: AclVDecReportTh Kdump: loaded Tainted: P           OE     5.4.0-110-generic #124-Ubuntu
[  243.191599] Hardware name: Deepglint Face Comparison Host Device (standard)/DG-ATX, BIOS 1.5 10/05/2020
[  243.191599] RIP: 0010:vprintk_emit+0x203/0x290
[  243.191599] Code: 9d 00 00 00 c6 05 1c 86 e9 01 01 48 c7 c7 f0 fd 39 90 c6 07 00 0f 1f 40 00 84 d2 74 70 0f b6 05 03 86 e9 01 84 c0 74 0d f3 90 <0f> b6 15 f6 85 e9 01 84 d2 75 f3 e8 0d 0b 00 00 48 89 df 57 9d 0f
[  243.191599] RSP: 0018:ffff9cfe638ffcd0 EFLAGS: 00000002
[  243.191600] RAX: 0000000000000001 RBX: 0000000000000202 RCX: ffff888e741e4740
[  243.191600] RDX: 0000000000000001 RSI: 0000000000000002 RDI: ffffffff9039fdf0
[  243.191600] RBP: ffff9cfe638ffd10 R08: 000000389f4659d7 R09: ffffffff9039fe04
[  243.191603] R10: 000000000035e3df R11: 000000000001778c R12: 000000000000005f
[  243.191603] R13: 000000000035e3e0 R14: 0000000000000000 R15: ffff9cfe638ffd50
[  243.191604] FS:  00007fcbbf6f7700(0000) GS:ffff888ecea00000(0000) knlGS:0000000000000000
[  243.191605] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  243.191605] CR2: 00007fcc5d7ce000 CR3: 000000074beb6004 CR4: 00000000003606f0
[  243.191605] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  243.191605] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  243.191605] Call Trace:
[  243.191606]  vprintk_default+0x29/0x50
[  243.191606]  vprintk_func+0x4c/0xc0
[  243.191606]  printk+0x58/0x6f
[  243.191606]  devdrv_ioctl.cold+0x312/0x442 [drv_devdrv_host]
[  243.191606]  tsdrv_comm_ioctl+0x8e/0xd0 [drv_devdrv_host]
[  243.191606]  drv_davinci_intf_ioctl+0x5e/0x80 [drv_davinci_intf_host]
[  243.191607]  do_vfs_ioctl+0x407/0x670
[  243.191607]  ? put_cred_rcu+0x88/0xa0
[  243.191607]  ksys_ioctl+0x67/0x90
[  243.191607]  __x64_sys_ioctl+0x1a/0x20
[  243.191607]  do_syscall_64+0x57/0x190
[  243.191607]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  243.191608] RIP: 0033:0x7fcc4deb0217
[  243.191608] Code: b3 66 90 48 8b 05 71 4c 2d 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 41 4c 2d 00 f7 d8 64 89 01 48
[  243.191608] RSP: 002b:00007fcbbf6ec918 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  243.191609] RAX: ffffffffffffffda RBX: 00007fcbbf6ece10 RCX: 00007fcc4deb0217
[  243.191609] RDX: 00007fcbbf6eca70 RSI: 00000000c0784416 RDI: 0000000000000009
[  243.191609] RBP: 00007fcbbf6ec950 R08: 000000000000001e R09: 00007fcbbf6ece10
[  243.191609] R10: 00007fcc36288718 R11: 0000000000000246 R12: 0000000000000000
[  243.191609] R13: 0000000000000045 R14: 00007fcbbf6f7700 R15: 00007fcc3a44cf80
[  243.191610] NMI backtrace for cpu 1
[  243.191610] CPU: 1 PID: 1591 Comm: RT_RECV Kdump: loaded Tainted: P           OE     5.4.0-110-generic #124-Ubuntu
[  243.191610] Hardware name: Deepglint Face Comparison Host Device (standard)/DG-ATX, BIOS 1.5 10/05/2020
[  243.191610] RIP: 0010:sys_imageblit+0x44d/0x1000 [sysimgblt]
[  243.191611] Code: 85 04 00 00 00 48 89 55 c8 48 89 45 b8 44 3b 5d c0 77 4c 48 8b 45 b8 4c 89 55 d0 48 89 da 4c 89 d6 b9 08 00 00 00 4c 8d 0c 03 <0f> be 06 44 29 d9 48 83 c2 04 d3 f8 44 21 e0 45 8b 14 86 41 21 fa
[  243.191611] RSP: 0018:ffff9cfe4f5bb8b8 EFLAGS: 00000083
[  243.191611] RAX: 0000000000000000 RBX: ffff9cfe4c245960 RCX: 0000000000000003
[  243.191612] RDX: ffff9cfe4c2459b4 RSI: ffff888ec8fc3d7c RDI: 0000000000aaaaaa
[  243.191612] RBP: ffff9cfe4f5bb928 R08: 0000000000000000 R09: ffff9cfe4c245c20
[  243.191612] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000001
[  243.191612] R13: ffff888ec0992800 R14: ffffffffc07f2080 R15: 0000000000000000
[  243.191612] FS:  00007fcc3a975700(0000) GS:ffff888ecea80000(0000) knlGS:0000000000000000
[  243.191613] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  243.191613] CR2: 00007fcc5d7ce000 CR3: 000000074beb6005 CR4: 00000000003606e0
[  243.191613] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  243.191613] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  243.191613] Call Trace:
[  243.191614]  drm_fb_helper_sys_imageblit+0x17/0x40 [drm_kms_helper]
[  243.191614]  bit_putcs+0x2e2/0x590
[  243.191614]  fbcon_putcs+0xf8/0x110
[  243.191614]  ? bit_clear+0x110/0x110
[  243.191614]  fbcon_redraw.isra.0+0x101/0x220
[  243.191614]  fbcon_scroll+0x7cf/0xd00
[  243.191614]  con_scroll+0x148/0x1e0
[  243.191615]  lf+0xa9/0xb0
[  243.191615]  vt_console_print+0x31f/0x400
[  243.191615]  console_unlock+0x392/0x4e0
[  243.191615]  vprintk_emit+0x17e/0x290
[  243.191615]  vprintk_default+0x29/0x50
[  243.191615]  vprintk_func+0x4c/0xc0
[  243.191616]  printk+0x58/0x6f
[  243.191616]  devdrv_ioctl.cold+0x312/0x442 [drv_devdrv_host]
[  243.191616]  ? __switch_to_asm+0x34/0x70
[  243.191617]  tsdrv_comm_ioctl+0x8e/0xd0 [drv_devdrv_host]
[  243.191617]  drv_davinci_intf_ioctl+0x5e/0x80 [drv_davinci_intf_host]
[  243.191617]  do_vfs_ioctl+0x407/0x670
[  243.191618]  ? __schedule+0x2eb/0x740
[  243.191618]  ksys_ioctl+0x67/0x90
[  243.191618]  __x64_sys_ioctl+0x1a/0x20
[  243.191618]  do_syscall_64+0x57/0x190
[  243.191618]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  243.191618] RIP: 0033:0x7fcc4deb0217
[  243.191619] Code: b3 66 90 48 8b 05 71 4c 2d 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 41 4c 2d 00 f7 d8 64 89 01 48
[  243.191619] RSP: 002b:00007fcc3a96ab58 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  243.191619] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fcc4deb0217
[  243.191620] RDX: 00007fcc3a96ac30 RSI: 00000000c0784405 RDI: 0000000000000009
[  243.191620] RBP: 00007fcc3a96ab90 R08: 0000000000000000 R09: 0000000000000000
[  243.191622] R10: 00007fcc4eac8d98 R11: 0000000000000246 R12: 00007fcc364d9390
[  243.191622] R13: 00007fcc3a96af78 R14: 00007fcc3a96af74 R15: 0000000000000000
[  243.191624] Kernel panic - not syncing: hung_task: blocked tasks
[  243.191625] CPU: 3 PID: 36 Comm: khungtaskd Kdump: loaded Tainted: P           OE     5.4.0-110-generic #124-Ubuntu
[  243.191625] Hardware name: Deepglint Face Comparison Host Device (standard)/DG-ATX, BIOS 1.5 10/05/2020
[  243.191625] Call Trace:
[  243.191626]  dump_stack+0x6d/0x8b
[  243.191628]  panic+0x101/0x2e3
[  243.191629]  watchdog+0x33a/0x390
[  243.191630]  kthread+0x104/0x140
[  243.191630]  ? hungtask_pm_notify+0x40/0x40
[  243.191631]  ? kthread_park+0x90/0x90
[  243.191632]  ret_from_fork+0x35/0x40

系统环境:

内核版本:

驱动版本:

调查方式

关键日志

关于昇腾

新闻与活动

交流与资讯

支持与服务

开源社区