CacheKeyByIdAndIndex

Applicable Products

Product	Supported (Yes/No)
Ascend 950PR/Ascend 950DT	No
Atlas A3 training products/Atlas A3 inference products	Yes
Atlas A2 training products/Atlas A2 inference products	Yes
Atlas 200I/500 A2 inference products	No
Atlas inference products	No
Atlas training products	No

Note: For the Atlas A2 training products/Atlas A2 inference products, only the Atlas 800I A2 inference server and A200I A2 Box heterogeneous subrack are supported.

Function Description

Constructs a CacheKeyByIdAndIndex instance, which is usually used as the parameter type in pull_cache.

Prototype

__init__(self, cluster_id: int, cache_id: int, batch_index=0)

Parameters

Parameter	Data Type	Value Description
cluster_id	int	Cluster ID of the node where the cache is located.
cache_id	int	Cache ID associated with the cache.
batch_index	int	Batch index of the cache. The default value is 0.

Example

from llm_datadist import CacheKeyByIdAndIndex
cache_key = CacheKeyByIdAndIndex(0, 1, 0)

Returns

In normal cases, a CacheKeyByIdAndIndex instance is returned.

If the input data type is incorrect, a TypeError or ValueError is thrown.

Constraints

None

Parent topic: API Reference