GoogleCloudAiplatformV1SpeculativeDecodingSpecNgramSpeculation class

N-Gram speculation works by trying to find matching tokens in the previous prompt sequence and use those as speculation for generating new tokens.

Constructors

GoogleCloudAiplatformV1SpeculativeDecodingSpecNgramSpeculation.new({int? ngramSize})

GoogleCloudAiplatformV1SpeculativeDecodingSpecNgramSpeculation.fromJson(Map json_)

Properties

hashCode → int

The hash code for this object.

no setter, inherited

ngramSize ↔ int?

The number of last N input tokens used as ngram to search/match against the previous prompt sequence.

getter/setter pair

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toJson() → Map<String, dynamic>

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited