Introduction to HIXL
HIXL is an Ascend unilateral communication library that provides high-performance, zero-copy point-to-point data transmission capabilities for cluster scenarios and exposes its capabilities through simple APIs.
In distributed memory pool scenarios, upper-layer frameworks such as Mooncake Store already provide KV cache management, but they rely on local and remote addresses for remote memory reads and writes at the transport layer. HIXL addresses this need by offering a pure transmission capability based directly on local and remote addresses.
Dimension |
HIXL |
LLM-DataDist |
|---|---|---|
Scenario |
It is mainly used for memory transmission between distributed clusters. |
It is mainly used for KV cache transmission and movement between distributed clusters. |
Main functions |
|
|