LlmDataDist Constructor

Applicability

Product

Supported (√/x)

Atlas 350 Accelerator Card

x

Atlas A3 training product/Atlas A3 inference product

Atlas A2 training product/Atlas A2 inference product

Atlas 200I/500 A2 inference product

x

Atlas inference product

x

Atlas training product

x

Note: For Atlas A2 training product/Atlas A2 inference product, only the Atlas 800I A2 inference server and A200I A2 Box heterogeneous subrack are supported.

Function Description

Creates an LLM-DataDist object.

Prototype

1
LlmDataDist(uint64_t cluster_id, LlmRole role)

Parameters

Parameter

Input/Output

Description

cluster_id

Input

Cluster ID that identifies the LLM-DataDist instance. It must be unique among all participants in the link establishment.

role

Input

Current role, whose type is LlmRole. This parameter is used only to identify the current role and does not affect the transmission process.

Returns

None

Exception Handling

None

Restrictions

None