InitializerType

Function

Defines the weight initialization type enumeration, which defines the initialization mode of the embedding table weight.

Prototype

1
2
3
4
class InitializerType(Enum):
     LINEAR ="linear"
     TRUNCATED_NORMAL ="truncated_normal"
     UNIFORM = "uniform"

Parameters

Parameter

Description

LINEAR

Linear initialization.

TRUNCATED_NORMAL

Perform initialization using truncated normal distribution.

UNIFORM

Perform initialization using uniform distribution.

Return Value

  • Success: The enumerated values of InitializerType are returned.
  • Failure: An exception is thrown.