speculativeTokenCount property

int? speculativeTokenCount
getter/setter pair

The number of speculative tokens to generate at each step.

Implementation

core.int? speculativeTokenCount;