LlmRole
Specifies the role of an LLM-DataDist node.
1 2 3 4 5 6 | enum class LlmRole : int32_t { kPrompt = 1, // Role: Prompt kDecoder = 2, // Role: Decoder kMix = 3, // Role: Mix kEnd // Invalid value } |
Parent topic: Data Structures
Specifies the role of an LLM-DataDist node.
1 2 3 4 5 6 | enum class LlmRole : int32_t { kPrompt = 1, // Role: Prompt kDecoder = 2, // Role: Decoder kMix = 3, // Role: Mix kEnd // Invalid value } |