CANN Commercial Edition

Compute Architecture for Neural Networks (CANN) is designed for AI tasks on Ascend hardware. It supports AI frameworks from MindSpore, PyTorch, to TensorFlow. CANN boosts the performance of AI processors and programming, and offers ready-to-use APIs for different uses, allowing you to quickly create AI applications and services on the Ascend platform.

Environment Setup

Programming Guide

API References

  • Ascend C APIs

    Provides basic and advanced Ascend C APIs.

  • Runtime APIs

    Provides unified APIs for applications and frameworks to efficiently utilize AI processor compute.

  • GE APIs

    Constructs graphs that run directly on the Ascend platform through GE APIs.

  • Operator Library

    Provides a wide array of high-performance operators with deep optimization and hardware affinity.

  • Huawei Collective Communication Library (HCCL)

    A high-performance collective communication library based on Ascend AI Processors, enabling data parallelism and model parallelism in single-server multi-device and multi-server multi-device modes.

  • HIXL Unilateral Communication Library

    Guides developers how to use unilateral communication library APIs for inter-cluster data transmission and build a disaggregated LLM inference framework.

  • ATB Acceleration Library

    Describes how to use the Ascend Transformer Boost acceleration library to improve the efficiency of Transformer model training and inference development.

  • SiP Acceleration Library

    Describes how to use high-performance signal processing operators.

  • DVPP Media Acceleration Library

    DVPP is an image processing unit in the AI Processor that speeds up media processing with APIs. It handles VPC image processing, JPEG encoding and decoding, and video encoding and decoding.

Development Tools

Compiler

  • BiSheng Compiler

    Describes how to use the BiSheng compiler to build operator code into binary executable files and dynamic libraries.

  • AscendNPU IR

    Describes the intermediate representation (IR) built based on MLIR, designed for building Ascend-optimized operators.

Appendixes

  • Troubleshooting

    Describes how to locate and rectify faults.

  • Log Reference

    Describes the log content format, how to view logs, and how to set log levels.

  • Environment Variables

    Describes the environment variables for building AI applications and services based on CANN.

  • Graph Fusion and UB Fusion Patterns

    Provides built-in graph fusion and UB fusion patterns of Ascend AI processors. Graph fusion and UB fusion are key methods for improving the performance of the entire network.

  • Basic Data Structures and APIs

    Describes the basic data structures and APIs on which operator development and graph development depend.

  • Version-related Documents

    Provides the CANN communication matrix, open-source software notice, and vulnerability fixes list.

Others

  • Feature Vector Search

    Offers hardware-accelerated APIs for short feature retrieval. These APIs let you add and remove feature libraries, change and delete feature vectors, and perform searches.

  • RPing Development

    Describes the RDMA-based network detection technology RPing for sending detection packets, recording network latency, and collecting statistics on packet sending and receiving.

  • TBE & AI CPU Operator Development

    Describes how to develop custom TBE and AI CPU operators using corresponding APIs.

  • LLM DataDist Development

    Disaggregates model inference using LLM DataDist APIs to improve inference throughput.

  • DataFlow Development

    Constructs, modifies, compiles, and executes computational graphs through DataFlow C++ and Python APIs, and provides UDF APIs for you to write custom processing functions through FuncProcessPoint and GraphProcessPoint.

  • ISP Image Optimization

    Describes how to tune algorithms and functions related to the image signal processing (ISP).