ActivationType

Enumerated Items

• ACTIVATION_UNDEFINED
• ACTIVATION_RELU
• ACTIVATION_GELU
• ACTIVATION_FAST_GELU
• ACTIVATION_SWISH
• ACTIVATION_LOG
• ACTIVATION_SWIGLU_FORWARD
• ACTIVATION_SWIGLU_BACKWARD
• ACTIVATION_SIGMOID
• ACTIVATION_FASTER_GELU_FORWARD
• ACTIVATION_MAX

Example

torch_atb.ActivationType.ACTIVATION_UNDEFINED