LlmDataDist Constructor

Applicability

Product

Supported (Yes/No)

Atlas 350 Accelerator Card

No

Atlas A3 training product/Atlas A3 inference product

Yes

Atlas A2 training product/Atlas A2 inference product

Yes

Atlas 200I/500 A2 inference product

No

Atlas inference product

No

Atlas training product

No

Note: For the Atlas A2 training product/Atlas A2 inference product, only the Atlas 800I A2 inference server and A200I A2 Box heterogeneous subrack are supported.

Function Description

Creates an LLM-DataDist instance.

Prototype

1
LlmDataDist(uint64_t cluster_id, LlmRole role)

Parameters

Parameter

Input/Output

Description

cluster_id

Input

Cluster ID that identifies the LLM-DataDist instance. It must be unique among all participants in the link establishment.

role

Input

Current role, whose type is LlmRole.

Returns

None

Exception Handling

None

Constraints

None