GoogleCloudAiplatformV1SpeculativeDecodingSpec class
Configuration for Speculative Decoding.
Constructors
- GoogleCloudAiplatformV1SpeculativeDecodingSpec.new({GoogleCloudAiplatformV1SpeculativeDecodingSpecDraftModelSpeculation? draftModelSpeculation, GoogleCloudAiplatformV1SpeculativeDecodingSpecNgramSpeculation? ngramSpeculation, int? speculativeTokenCount})
- GoogleCloudAiplatformV1SpeculativeDecodingSpec.fromJson(Map json_)
Properties
- draftModelSpeculation ↔ GoogleCloudAiplatformV1SpeculativeDecodingSpecDraftModelSpeculation?
-
draft model speculation.
getter/setter pair
- hashCode → int
-
The hash code for this object.
no setterinherited
- ngramSpeculation ↔ GoogleCloudAiplatformV1SpeculativeDecodingSpecNgramSpeculation?
-
N-Gram speculation.
getter/setter pair
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
- speculativeTokenCount ↔ int?
-
The number of speculative tokens to generate at each step.
getter/setter pair
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toJson(
) → Map< String, dynamic> -
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited