Header Files and Library Files
You can reference the header files and library files of HIXL APIs for compiling and running your apps only after the firmware, driver, and CANN software are installed.
Include the dependency header files based on the HIXL APIs to be called. Refer to the table below for details.
The header files of HIXL APIs are stored in the ${INSTALL_DIR}/include/ directory, and the library files are stored in the ${INSTALL_DIR}/lib64/ directory. ${INSTALL_DIR} must be replaced with the actual CANN installation path. For example, if the installation is performed by the root user, the default file storage path is /usr/local/Ascend/cann.
Header File |
Function |
Matching Library File |
|---|---|---|
llm_datadist/llm_datadist.h |
Provides API capabilities with KV cache semantics for foundation model KV cache transmission scenarios. Functions such as role management, link management, KV cache registration, continuous KV cache transmission, and KV block transmission are supported. |
libllm_datadist.so |
hixl/hixl.h |
Provides unilateral direct data transmission capabilities that are easy-to-use and zero-copy for point-to-point data transmission scenarios. Functions such as initialization/deinitialization, memory registration/deregistration, link establishment/disconnection, and data transmission are supported. |
libcann_hixl.so |
cs/hixl_cs.h |
Provides unilateral zero-copy direct data transmission capabilities in client-server mode for scenarios where the client-server mode is used. Functions such as creation/destruction, link establishment, memory registration/deregistration, remote memory description obtaining, and data transmission on the client as well as creation/destruction and memory registration/deregistration on the server are supported. |
libcann_hixl.so |