DeallocateCache

Applicable Products

Product

Supported (Yes/No)

Ascend 950PR/Ascend 950DT

No

Atlas A3 training products/Atlas A3 inference products

Yes

Atlas A2 training products/Atlas A2 inference products

Yes

Atlas 200I/500 A2 inference products

No

Atlas inference products

No

Atlas training products

No

Note: For the Atlas A2 training products/Atlas A2 inference products, only the Atlas 800I A2 inference server and A200I A2 Box heterogeneous subrack are supported.

Function Description

Deallocates a cache.

Prototype

1
Status DeallocateCache(int64_t cache_id)

Parameters

Parameter

Input/Output

Value Description

cache_id

Input

Cache ID.

Example

1
Status ret = llm_datadist.DeallocateCache(cache.cache_id)

Returns

  • LLM_SUCCESS: Success.
  • Other values: Failure.

Constraints

Before calling this API, call the Initialize API to complete initialization.