defragmentationThreshold property

double? get defragmentationThreshold

defragment the KV cache if holes/size > thold, < 0 disabled (default)

Implementation

double? get defragmentationThreshold => _defragmentationThreshold;

set defragmentationThreshold (double? value)

Implementation

set defragmentationThreshold(double? value) {
  _defragmentationThreshold = value;
  notifyListeners();
}