GgmlType enum

Enum representing different GGML (General Graphical Modeling Language) types.

Each type corresponds to a specific data format or quantization level used in GGML.

The available types are:

• f32: 32-bit floating point
• f16: 16-bit floating point
• q4_0, q4_1, q4_2, q4_3: 4-bit quantization levels
• q5_0, q5_1: 5-bit quantization levels
• q8_0, q8_1: 8-bit quantization levels
• q2_k, q3_k, q4_k, q5_k, q6_k, q8_k: Various quantization levels with different bit depths
• iq2_xxs, iq2_xs, iq3_xxs, iq1_s, iq4_nl, iq3_s, iq2_s, iq4_xs: Integer quantization levels with different bit depths and suffixes
• i8, i16, i32, i64: Integer types with different bit depths
• f64: 64-bit floating point
• iq1_m: Integer quantization with a specific suffix
• bf16: Brain floating point 16-bit
• q4_0_4_4, q4_0_4_8, q4_0_8_8: Mixed quantization levels
• tq1_0, tq2_0: Tensor quantization levels

The fromString method allows converting a string representation of a GGML type to its corresponding enum value.

Inheritance

• Object
• Enum
• GgmlType

Available extensions

• EnumName

Values

f32 → const GgmlType

32-bit floating point

f16 → const GgmlType

16-bit floating point

q4_0 → const GgmlType

4-bit quantization level 0

q4_1 → const GgmlType

4-bit quantization level 1

q4_2 → const GgmlType

4-bit quantization level 2

q4_3 → const GgmlType

4-bit quantization level 3

q5_0 → const GgmlType

5-bit quantization level 0

q5_1 → const GgmlType

5-bit quantization level 1

q8_0 → const GgmlType

8-bit quantization level 0

q8_1 → const GgmlType

8-bit quantization level 1

q2_k → const GgmlType

2-bit quantization level for keys

q3_k → const GgmlType

3-bit quantization level for keys

q4_k → const GgmlType

4-bit quantization level for keys

q5_k → const GgmlType

5-bit quantization level for keys

q6_k → const GgmlType

6-bit quantization level for keys

q8_k → const GgmlType

8-bit quantization level for keys

iq2_xxs → const GgmlType

Integer quantization level 2 xxs

iq2_xs → const GgmlType

Integer quantization level 2 xs

iq3_xxs → const GgmlType

Integer quantization level 3 xxs

iq1_s → const GgmlType

Integer quantization level 1 s

iq4_nl → const GgmlType

Integer quantization level 4 nl

iq3_s → const GgmlType

Integer quantization level 3 s

iq2_s → const GgmlType

Integer quantization level 2 s

iq4_xs → const GgmlType

Integer quantization level 4 xs

i8 → const GgmlType

8-bit integer

i16 → const GgmlType

16-bit integer

i32 → const GgmlType

32-bit integer

i64 → const GgmlType

64-bit integer

f64 → const GgmlType

64-bit floating point

iq1_m → const GgmlType

Integer quantization level 1 m

bf16 → const GgmlType

Brain floating point 16-bit

q4_0_4_4 → const GgmlType

Mixed quantization level 4-4

q4_0_4_8 → const GgmlType

Mixed quantization level 4-8

q4_0_8_8 → const GgmlType

Mixed quantization level 8-8

tq1_0 → const GgmlType

Tensor quantization level 1

tq2_0 → const GgmlType

Tensor quantization level 2

Properties

hashCode → int

The hash code for this object.

no setter, inherited

index → int

A numeric identifier for the enumerated value.

no setter, inherited

name → String

Available on Enum, provided by the EnumName extension

The name of the enum value.

no setter

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited

Static Methods

fromString(String value) → GgmlType

Converts a string value to the corresponding GgmlType enum value.

Constants

values → const List<GgmlType>

A constant List of the values in this enum, in order of their declaration.