ggml_ftype class abstract

model file types

Constructors

ggml_ftype.new()

Properties

hashCode int
The hash code for this object.
no setterinherited
runtimeType Type
A representation of the runtime type of the object.
no setterinherited

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() String
A string representation of this object.
inherited

Operators

operator ==(Object other) bool
The equality operator.
inherited

Constants

GGML_FTYPE_ALL_F32 → const int
GGML_FTYPE_MOSTLY_BF16 → const int
except 1d tensors
GGML_FTYPE_MOSTLY_F16 → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ1_M → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ1_S → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ2_S → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ2_XS → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ2_XXS → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ3_S → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ3_XXS → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ4_NL → const int
except 1d tensors
GGML_FTYPE_MOSTLY_IQ4_XS → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q2_K → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q3_K → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q4_0 → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q4_1 → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q4_1_SOME_F16 → const int
tok_embeddings.weight and output.weight are F16
GGML_FTYPE_MOSTLY_Q4_K → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q5_0 → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q5_1 → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q5_K → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q6_K → const int
except 1d tensors
GGML_FTYPE_MOSTLY_Q8_0 → const int
except 1d tensors
GGML_FTYPE_UNKNOWN → const int