# CANN

异构计算架构CANN（Compute Architecture for Neural Networks）是昇腾针对AI场景推出的异构计算架构，向上支持多种AI框架，包括MindSpore、PyTorch、TensorFlow等，向下服务AI处理器与编程，发挥承上启下的关键作用，是提升昇腾AI处理器计算效率的关键平台。同时针对多样化应用场景，提供多层次编程接口，支持用户快速构建基于昇腾平台的AI应用和业务。

#### CANN 9.2.0的关键特性

- 昇腾社区上线CANN版本配套查询助手，用户可快速获取CANN与上下游软件配套关系，点击  查看详情(https://www.hiascend.com/developer/download/compatibility)
。
- 基于Ascend 950PR&950DT系列产品，Matmul、FA、SFA、BSA等算子支持8bit低精度计算，Matmul、GroupedMatmul、BSA等进一步支持4bit低精度计算，低精能力全面覆盖Deepseek、GLM、Kimi等模型权重、激活、KV Cache和Attention等关键路径，点击  查看详情(https://atomgit.com/cann/docs/blob/9.2.0/docs/zh/ops-lib/0_README.md)
。
- KDA、SMLA、MegaMoe等融合算子进一步提升流水并行度，支持Kimi-K3、GLM5.2等模型性能提升20%，点击  查看详情(https://atomgit.com/cann/ops-transformer/tree/9.2.0)
。
- 扩展稀疏Attention系列算子的正反向计算能力，覆盖注意力计算、稀疏索引选择与梯度计算等关键环节，支撑大模型稀疏训练，点击  查看详情(https://atomgit.com/cann/ops-transformer/tree/9.2.0/attention)
。
- 基于Ascend 950PR&950DT系列产品，支持MoE训练场景的Dispatch、Combine，通过AIV直驱URMA发起后台通信，配合DualPipe调度，实现训练中计算与通信的并行，点击  查看详情(https://atomgit.com/cann/ops-transformer/tree/9.2.0/mc2)
。
- 基于Ascend 950PR&950DT系列产品，支持Engram分布式推理，将Engram表卸载（offload）至Host内存，通过URMA与Ubmem的接力能力，实现跨卡访问远端Host内存，点击  查看详情(https://atomgit.com/cann/ops-transformer/tree/9.2.0/mc2)
。
- PyPTO新增PyPTO PRO编程模式，为算子开发者进一步提供硬件的控制力，点击  查看详情(https://atomgit.com/cann/pypto/blob/master/docs/zh/guide/introduction.md)
。
- 基于Ascend 950PR&950DT系列产品，CATLASS新增支持Python风格核函数，提供丰富的样例库，点击  查看详情(https://atomgit.com/cann/catlass/blob/master/README.md)
。
- 算子新增支持Batch一致性计算能力，点击  查看详情(https://atomgit.com/cann/ops-nn/blob/9.2.0/docs/zh/context/batch_consistency.md)
。
- 新增支持inductor路线的自动融合能力，自动识别并融合view、Norm、elementwise、Concat等算子，提升模型执行性能，点击  查看详情(https://atomgit.com/cann/graph-autofusion/blob/master/docs/zh/autofuse/introduction/enable_autofuse_inductor.md)
。


#### 快速上手

版本说明(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/softwareinst/releasenote/9.2.0/release-notes.md)

快速安装(https://www.hiascend.com/cann/download?versionId=749&ids=d806,h0501,h0601,h0702)

Ascend C编程指南(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/programug/Ascendcopdevg/docs/guide/入门教程/Ascend-C概述与学习路径.md)


#### 查阅CANN文档

按工作流程、功能领域、API参考等维度查阅CANN相关文档。


**表1 发行与安装**

| 发行与安装 |
| --- |
| 版本说明(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/softwareinst/releasenote/9.2.0/release\-notes.md) |
| 快速安装(https://www.hiascend.com/cann/download) |
| 软件安装(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/softwareinst/instg/instg\_0000.html) |
| 昇腾产品形态说明(https://www.hiascend.com/document/detail/zh/Glossary/productform/hardwaredesc\_0001.html) |


**表2 学习与教程**

| 学习与教程 |
| --- |
| CANN\-learning\-hub(https://atomgit.com/cann/cann\-learning\-hub) |
| CANN\-samples(https://atomgit.com/cann/cann\-samples) |


**表3 编程语言**

| 编程语言 |
| --- |
| Ascend C编程指南(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/programug/Ascendcopdevg/docs/guide/入门教程/Ascend\-C概述与学习路径.md) |
| CATLASS编程指南(https://atomgit.com/cann/catlass/blob/master/docs/zh/1\_Practice/10\_innovative\_example\_development\_guide.md) |
| PyPTO算子开发(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/programug/pyptoopdevg/docs/zh/tutorials/introduction/introduction.md) |
| 图开发(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/programug/graphdevg/docs/zh/user\_guides/graph\_dev/overview/GE\_definition.md) |


**表4 编译器**

| 编译器 |
| --- |
| 毕昇编译器(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/compiler/BishengCompiler/atlas\_bisheng\_10\_0001.html) |
| PTO虚拟指令集(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/compiler/ptoisa/docs/PTO\-ISA\-Header\-and\-Library\-Description.md) |
| AscendNPU IR(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/compiler/AscendNPUIR/docs/source/zh\_cn/introduction/introduction.md) |
| PTOAS(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/compiler/ptoas/overview/what\_is\_ptoas.md) |


**表5 API参考**

| API参考 |
| --- |
| 头文件和库文件说明(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/API/headerliblist/hfandlf\_09\_0001.html) |
| Ascend C API(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/API/ascendcopapi/docs/zh/api/api\_list.md) |
| PyPTO API(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/API/pyptoapi/docs/zh/api/tensor/pypto\-Tensor\_introduction.md) |
| 算子库API(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/API/aolapi/docs/zh/ops\-lib/introduction.md) |
| Runtime运行时API(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/API/runtimeapi/docs/zh/api\_ref/01\_overview.md) |
| GE图引擎API(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/API/ascendgraphapi/docs/zh/api/graph\_engine\_api/header\_and\_library\_files\_description.md) |


**表6 算子库**

| 算子库 |
| --- |
| ops\-math(https://atomgit.com/cann/ops\-math/tree/9.2.0/docs) |
| ops\-cv(https://atomgit.com/cann/ops\-cv/tree/9.2.0/docs) |
| ops\-nn(https://atomgit.com/cann/ops\-nn/tree/9.2.0/docs) |
| ops\-transformer(https://atomgit.com/cann/ops\-transformer/tree/9.2.0/docs) |


**表7 通信库**

| 通信库 |
| --- |
| HCCL集合通信库(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/commlib/hcclug/docs/zh/user\_guide/hccl\_intro.md) |
| SHMEM通信库(https://shmem\-doc.pages.dev/) |
| HIXL单边通信库(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/commlib/hixlug/docs/zh/guide/introduction.md) |
| 通信算子开发(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/commlib/commopdev/docs/zh/comm\_op\_dev\_guide/intro.md) |


**表8 加速库**

| 加速库 |
| --- |
| SiP加速库(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/acce/SiP/docs/zh/Installation\_Operation\_Guide/overview.md) |
| DVPP媒体加速库(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/acce/dvpp/dvpp\_03\_0000.html) |
| ATB加速库(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/acce/ascendtb/ascendtb\_0001.html) |


**表9 调试与分析工具**

| 调试与分析工具 |
| --- |
| 算子开发工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/optool/MindStudio/26.1.0/zh/user\_guide/msot\_user\_guide.md) |
| 算子编译工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/opcompiletool/docs/zh/operator\_compilation\_tool/introduction.md) |
| 精度调试工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/ModelAccuracyAnalyzer/atlasaccuracy\_16\_1000.html) |
| 性能调优工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/Profiling/docs/zh/profiling/overview.md) |
| 内存分析工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/msMemScope/docs/zh/quick\_start/quick\_start.md) |
| 分析迁移工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/migrationtools/msfmktransplt/README.md) |
| ATC离线模型编译工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/atctool/docs/zh/user\_guides/atc\_tools/overview/learning\_guide.md) |
| AOE调优工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/aoe/auxiliarydevtool\_aoe\_0001.html) |
| HCCL性能测试工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/hccltool/docs/zh/hccl\_test/introduction.md) |
| AMCT模型压缩工具(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/devaids/amct/atlasamct\_16\_0001.html) |


**表10 参考**

| 参考 |
| --- |
| 故障处理(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/maintenref/troubleshooting/docs/zh/troubleshooting/troubleshooting\_intro.md) |
| 日志参考(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/maintenref/logreference/docs/zh/log\_ref/log\_overview.md) |
| 环境变量参考(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/maintenref/envvar/docs/zh/env\-vars/intro.md) |
| 图融合和UB融合规则参考(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/maintenref/graphubfusionref/docs/zh/fusion\-patterns/Introduction.md) |
| AI框架算子支持清单(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/maintenref/aifosl/operatorlist\_00096.html) |
| 基础数据结构和接口(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/maintenref/basicdataapi/docs/zh/api/header\_and\_library\_files\_description.md) |
| 版本参考文档(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/maintenref/refdoc/refer001.html) |
| 术语(https://www.hiascend.com/document/detail/zh/Glossary/gls/gls\_0001.html) |


**表11 更多**

| 更多 |
| --- |
| 应用开发(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/others/acldevg/docs/zh/app\-dev/c/environment\_preparation.md) |
| 特征向量检索(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/others/fvsearch/aclcppdevg\_03\_1334.html) |
| RPing功能开发(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/others/rpingdev/RPing\_02\_0001.html) |
| TBE&AI CPU算子开发(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/others/tbeaicpudevg/atlasopdev\_10\_0001.html) |
| LLM DataDist开发(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/others/llmdatadistdev/docs/zh/user\_guides/llm\_datadist/introduction.md) |
| DataFlow开发(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/others/dataflowdevg/docs/zh/user\_guides/dflow/dflow\_dev/cpp/introduction\_to\_dataflow.md) |
| ISP图像调优(https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/920/others/ispdevug/ispdevug\_0001.html) |