Header Files and Library Files

Header files are stored in ${INSTALL_DIR}/include/llm_datadist. Replace ${INSTALL_DIR} with the CANN component directory. For example, if the installation is performed by the root user, the default file storage path is /usr/local/Ascend/cann.

**Table 1** Header files
Header File	Function	Matching Library File
llm_datadist.h	Provides APIs with KV cache semantics for model KV cache transmission. Supports functions such as role management, link management, KV cache registration, continuous KV cache transmission, and KV block transmission.	libllm_engine.so

Parent topic: API Reference