transfer_backend

Applicable Products

Product	Supported (√/x)
Ascend 950PR/Ascend 950DT	√
Atlas A3 training products/Atlas A3 inference products	√
Atlas A2 training products/Atlas A2 inference products	√
Atlas 200I/500 A2 inference products	x
Atlas inference products	x
Atlas training products	x

Note: For Atlas A2 training products/Atlas A2 inference products, only the Atlas 800I A2 inference server and A200I A2 Box heterogeneous subrack are supported.

Function Description

Sets the transmission backend used by LLM-DataDist.

Prototype

transfer_backend(transfer_backend)

Parameters

Parameter	Data Type	Description
transfer_backend	str	The value is "hixl", indicating that HIXL is used as the transmission engine backend.

Example

from llm_datadist import LLMConfig
llm_config = LLMConfig()
llm_config.transfer_backend = "hixl"

Returns

In normal cases, no value is returned.

If a parameter is incorrect, a TypeError or ValueError may be thrown.

Constraints

When initializing the parameter, you need to specify listen_ip_info. When the hixl transmission backend is used, each transmission end can function as both a client and a server.
Before initiating transmission with the peer end, you need to call link_clusters to establish a link.

Parent topic: LLMConfig