Constraints

probs must be a two-dimensional tensor.
The value of batch must be less than or equal to 512.
The value of logProbsSize must be less than or equal to that of voc_size.

Parent topic: TopkToppSamplingOperation