Overview

The DataCopy APIs provide comprehensive data transfer capabilities. They support various data transfer scenarios, and can perform on-the-fly format conversion, quantization, and activation during data movement. These APIs enable data transfer between local memory and global memory, as well as data transfer within local memory.

The following table lists DataCopy functions and their support for each transfer path.

Function

Description

Local Memory -> Global Memory

Global Memory -> Local Memory

Local Memory -> Local Memory

Basic data transfer

Provides basic data transfer capabilities. The original format and content of data remain unchanged during transfer. Both continuous and discontinuous data transfer are supported.

Enhanced data transfer

Enhances the data transfer capability. Compared with basic data transfer APIs, the enhanced data transfer API adds on-the-fly computation over the CO1->CO2 path.

Slice data transfer

Supports slice data transfer, which extracts subsets of multi-dimensional tensor data for transfer.

×

On-the-fly ND2NZ transfer

Supports ND-to-NZ format conversion during data transfer.

×

On-the-fly NZ2ND transfer

Supports NZ-to-ND format conversion during data transfer.

×

×

On-the-fly quantization and activation transfer

Supports quantization and ReLU activation during data transfer, as well as NZ-to-ND format conversion on the path from local memory to global memory.

×