ngramSize property

int? ngramSize

The number of last N input tokens used as ngram to search/match against the previous prompt sequence.

This is equal to the N in N-Gram. The default value is 3 if not specified.

Implementation

core.int? ngramSize;