topK property

int? topK

If set, the sampling process in each step is limited to the top_k tokens with highest probabilities.

Valid range: [1, 40] or 1000+. Small topK = less random. Large topK = more random.

Implementation

core.int? topK;