UnregisterKvCache

Applicable Products

Product	Supported (√/x)
Ascend 950PR/Ascend 950DT	√
Atlas A3 training products/Atlas A3 inference products	√
Atlas A2 training products/Atlas A2 inference products	√
Atlas 200I/500 A2 inference products	x
Atlas inference products	x
Atlas training products	x

Note: For Atlas A2 training products/Atlas A2 inference products, only the Atlas 800I A2 inference server and A200I A2 Box heterogeneous subrack are supported.

Function Description

Deregisters the local KV cache memory.

Prototype

Status UnregisterKvCache(int64_t cache_id);

Parameters

Parameter	Input/Output	Description
cache_id	Input	Cache ID generated during local registration. If the specified cache_id does not exist, LLM_SUCCESS is returned by default.

Returns

LLM_SUCCESS: Success.
Other values: Failure.

Constraints

Before calling this API, call the Initialize API to complete initialization. The value of cache_id must be that returned by the RegisterKvCache API.

Parent topic: LLM-DataDist APIs