vectorCacheHintSizeKB property

int? vectorCacheHintSizeKB
final

A non-binding hint at the maximum size of the vector cache in KB (default: 2097152 or 2 GB/GiB).

The actual size max cache size may be altered according to device and/or runtime settings. The vector cache is used to store vectors in memory to speed up search and indexing.

Note 1: cache chunks are allocated only on demand, when they are actually used. Thus, smaller datasets will use less memory.

Note 2: the cache is for one specific HNSW index; e.g. each index has its own cache.

Note 3: the memory consumption can temporarily exceed the cache size, e.g. for large changes, it can double due to multi-version transactions.

Implementation

final int? vectorCacheHintSizeKB;