MobileInferenceModel class
- Inheritance
-
- Object
- InferenceModel
- MobileInferenceModel
Constructors
-
MobileInferenceModel.new({required int maxTokens, required VoidCallback onClose, required MobileModelManager modelManager, required ModelType modelType, PreferredBackend? preferredBackend, List<
int> ? supportedLoraRanks})
Properties
- chat ↔ InferenceChat?
-
getter/setter pairinherited
- hashCode → int
-
The hash code for this object.
no setterinherited
- maxTokens → int
-
final
- modelManager → MobileModelManager
-
final
- modelType → ModelType
-
final
- onClose → VoidCallback
-
final
- preferredBackend → PreferredBackend?
-
final
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
- session → InferenceModelSession?
-
no setteroverride
-
supportedLoraRanks
→ List<
int> ? -
final
Methods
-
close(
) → Future< void> -
override
-
createChat(
{double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, int tokenBuffer = 256, String? loraPath}) → Future< InferenceChat> -
Creates a chat interface wrapping InferenceChat.
inherited
-
createSession(
{double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, String? loraPath}) → Future< InferenceModelSession> -
Creates a new InferenceModelSession for generation.
override
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited