Introduction to HIXL

HIXL is an Ascend unilateral communication library that provides high-performance, zero-copy point-to-point data transmission capabilities for cluster scenarios and exposes its capabilities through simple APIs.

In distributed memory pool scenarios, upper-layer frameworks such as Mooncake Store already provide KV cache management, but they rely on local and remote addresses for remote memory reads and writes at the transport layer. HIXL addresses this need by offering a pure transmission capability based directly on local and remote addresses.

Table 1 Comparison between HIXL and LLM-DataDist

Dimension

HIXL

LLM-DataDist

Scenario

It is mainly used for memory transmission between distributed clusters.

It is mainly used for KV cache transmission and movement between distributed clusters.

Main functions

  • Link management, including link disconnection and establishment.
  • Memory transmission, including memory registration, deregistration, and transmission.
  • Relay transmission
  • Link management, including link disconnection and establishment.
  • KV cache transmission, including KV cache registration, deregistration, and transmission.