WebInferenceModel class
- Inheritance
-
- Object
- InferenceModel
- WebInferenceModel
Constructors
-
WebInferenceModel.new({required ModelType modelType, required VoidCallback onClose, required int maxTokens, List<
int> ? loraRanks, required WebModelManager modelManager})
Properties
- chat ↔ InferenceChat?
-
getter/setter pairinherited
- hashCode → int
-
The hash code for this object.
no setterinherited
-
loraRanks
→ List<
int> ? -
final
- maxTokens → int
-
final
- modelManager → WebModelManager
-
final
- modelType → ModelType
-
final
- onClose → VoidCallback
-
final
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
- session ↔ InferenceModelSession?
-
getter/setter pairoverride-getter
Methods
-
close(
) → Future< void> -
override
-
createChat(
{double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, int tokenBuffer = 256, String? loraPath}) → Future< InferenceChat> -
Creates a chat interface wrapping InferenceChat.
inherited
-
createSession(
{double temperature = 0.8, int randomSeed = 1, int topK = 1, double? topP, String? loraPath}) → Future< InferenceModelSession> -
Creates a new InferenceModelSession for generation.
override
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited