InitializerType
Function
Defines the weight initialization type enumeration, which defines the initialization mode of the embedding table weight.
Prototype
1 2 3 4 | class InitializerType(Enum): LINEAR ="linear" TRUNCATED_NORMAL ="truncated_normal" UNIFORM = "uniform" |
Parameters
Parameter |
Description |
|---|---|
LINEAR |
Linear initialization. |
TRUNCATED_NORMAL |
Perform initialization using truncated normal distribution. |
UNIFORM |
Perform initialization using uniform distribution. |
Return Value
- Success: The enumerated values of InitializerType are returned.
- Failure: An exception is thrown.
Parent topic: Multi-level Cache Management APIs