gpt_tokenizer 0.1.1 copy "gpt_tokenizer: ^0.1.1" to clipboard
gpt_tokenizer: ^0.1.1 copied to clipboard

The implementation of BPE algorithm for sentence encode/decode

Stable versions of gpt_tokenizer

VersionMin Dart SDKUploadedDocumentationArchive
0.1.1Null safety3.014 months agoGo to the documentation of gpt_tokenizer 0.1.1Download gpt_tokenizer 0.1.1 archive
0.1.0Null safety2.182 years agoGo to the documentation of gpt_tokenizer 0.1.0Download gpt_tokenizer 0.1.0 archive
1
likes
120
points
292
downloads

Publisher

verified publishersimonwang.dev

Weekly Downloads

The implementation of BPE algorithm for sentence encode/decode

Documentation

API reference

License

MIT (license)

Dependencies

ffi, flutter_rust_bridge, meta, uuid

More

Packages that depend on gpt_tokenizer