promptTokenCount property

int? promptTokenCount

Number of tokens in the request.

When cached_content is set, this is still the total effective prompt size meaning this includes the number of tokens in the cached content.

Implementation

core.int? promptTokenCount;