mem_utilization

Applicable Products

Product	Supported (Yes/No)
Ascend 950PR/Ascend 950DT	No
Atlas A3 training products/Atlas A3 inference products	Yes
Atlas A2 training products/Atlas A2 inference products	Yes
Atlas 200I/500 A2 inference products	No
Atlas inference products	No
Atlas training products	No

Note: For the Atlas A2 training products/Atlas A2 inference products, only the Atlas 800I A2 inference server and A200I A2 Box heterogeneous subrack are supported.

Function Description

Configures the memory usage of ge.flowGraphMemMaxSize. Default value: 0.95

Prototype

mem_utilization(mem_utilization)

Parameters

Parameter	Data Type	Value Description
mem_utilization	float	Memory usage. The value ranges from 0.0 to 1.0 and defaults to 0.95.

Example

from llm_datadist import LLMConfig
llm_config = LLMConfig()
llm_config.mem_utilization = 0.95

Returns

In normal cases, no value is returned.

If a parameter is incorrect, a TypeError or ValueError may be thrown.

Constraints

None

Parent topic: LLMConfig