UnregisterKvCache

Applicability

Product	Supported (√/x)
Atlas 350 Accelerator Card	x
Atlas A3 training product/Atlas A3 inference product	√
Atlas A2 training product/Atlas A2 inference product	√
Atlas 200I/500 A2 inference product	x
Atlas inference product	x
Atlas training product	x

Note: For Atlas A2 training product/Atlas A2 inference product, only the Atlas 800I A2 inference server and A200I A2 Box heterogeneous subrack are supported.

Function Description

Deregisters the local KV cache memory.

Prototype

Status UnregisterKvCache(int64_t cache_id);

Parameters

Parameter	Input/Output	Description
cache_id	Input	Cache ID generated during local registration. If the specified cache_id does not exist, LLM_SUCCESS is returned by default.

Example

Click Gitee, download the sample package of the matching version based on the tag name, and obtain the sample from the cplusplus/level1_single_api/11_llm_data_dist directory.

Returns

LLM_SUCCESS: Success.
Other values: Failure.

Restrictions

Before calling this API, call the Initialize API to complete initialization. The value of cache_id must be that returned by the RegisterKvCache API.

Parent topic: LLM-DataDist APIs