gpt_tokenizer 0.1.0 copy "gpt_tokenizer: ^0.1.0" to clipboard
gpt_tokenizer: ^0.1.0 copied to clipboard

outdated

The implementation of BPE algorithm for sentence encode/decode

1
likes
80/ 160
pub points
290
downloads

We analyzed this package 2 days ago, and awarded it 80 pub points (of a possible 160):

Failed report section
Follow Dart file conventions
20 / 30trigger folding of the section

Failed check 0/10 points: Provide a valid pubspec.yaml

Failed to verify repository URL.

Please provide a valid repository URL in pubspec.yaml, such that:

  • repository can be cloned,
  • a clone of the repository contains a pubspec.yaml, which:,
    • contains name: gpt_tokenizer,
    • contains a version property, and,
    • does not contain a publish_to property.

Repository has multiple matching pubspec.yaml with name: gpt_tokenizer.

Passed check 5/5 points: Provide a valid README.md

Passed check 5/5 points: Provide a valid CHANGELOG.md

Passed check 10/10 points: Use an OSI-approved license

Detected license: MIT.

Partially passed report section
Provide documentation
10 / 20trigger folding of the section

Partially passed check 0/10 points: 20% or more of the public API has dartdoc comments

8 out of 86 API elements (9.3 %) have documentation comments.

Providing good documentation for libraries, classes, functions, and other API elements improves code readability and helps developers find and use your API. Document at least 20% of the public API elements.

To highlight public API members missing documentation consider enabling the public_member_api_docs lint.

Some symbols that are missing documentation: gpt_tokenizer.BPEWrapper, gpt_tokenizer.BPEWrapper.BPEWrapper.new, gpt_tokenizer.BPEWrapper.bpe, gpt_tokenizer.BPEWrapper.bridge, gpt_tokenizer.BPEWrapper.countToken.

Passed check 10/10 points: Package has an example

Failed report section
Platform support
20 / 20trigger folding of the section

Passed check 20/20 points: Supports 6 of 6 possible platforms (iOS, Android, Web, Windows, macOS, Linux)

  • ✓ Android

  • ✓ iOS

  • ✓ Windows

  • ✓ Linux

  • ✓ macOS

  • ✓ Web

Failed check 0/0 points: WASM compatibility

Unable to detect compatibility with runtime wasm, and this package will not be rewarded full points in a future version of the scoring model.

See https://dart.dev/web/wasm for details.

Failed report section
Pass static analysis
0 / 50trigger folding of the section

Failed check 0/50 points: code has no errors, warnings, lints, or formatting issues

Found 9 issues. Showing the first 2:

ERROR: The named parameter 'parseErrorData' is required, but there's no corresponding argument.

lib/src/gen/bridge_generated.dart:218:36

    ╷
218 │     return _platform.executeNormal(FlutterRustBridgeTask(
    │                                    ^^^^^^^^^^^^^^^^^^^^^
    ╵

To reproduce make sure you are using the lints_core and run dart analyze lib/src/gen/bridge_generated.dart

ERROR: The named parameter 'parseErrorData' is required, but there's no corresponding argument.

lib/src/gen/bridge_generated.dart:243:36

    ╷
243 │     return _platform.executeNormal(FlutterRustBridgeTask(
    │                                    ^^^^^^^^^^^^^^^^^^^^^
    ╵

To reproduce make sure you are using the lints_core and run dart analyze lib/src/gen/bridge_generated.dart

Failed report section
Support up-to-date dependencies
30 / 40trigger folding of the section

Failed check 0/10 points: All of the package dependencies are supported in the latest version

Package Constraint Compatible Latest Notes
ffi ^2.0.1 2.1.4 2.1.4
flutter_rust_bridge ^1.72.1 1.82.6 2.9.0
meta ^1.8.0 1.16.0 1.16.0
Transitive dependencies
Package Constraint Compatible Latest Notes
archive - 3.6.1 4.0.6
args - 2.7.0 2.7.0
async - 2.13.0 2.13.0
build_cli_annotations - 2.1.0 2.1.0
collection - 1.19.1 1.19.1
convert - 3.1.2 3.1.2
crypto - 3.0.6 3.0.6
fixnum - 1.1.1 1.1.1
http - 1.3.0 1.3.0
http_parser - 4.1.2 4.1.2
js - 0.6.7 0.7.2 Discontinued
logging - 1.3.0 1.3.0
mime - 2.0.0 2.0.0
path - 1.9.1 1.9.1
petitparser - 6.1.0 6.1.0
pool - 1.5.1 1.5.1
puppeteer - 3.16.0 3.18.0
shelf - 1.4.2 1.4.2
shelf_static - 1.1.3 1.1.3
shelf_web_socket - 1.0.4 3.0.0
source_span - 1.10.1 1.10.1
sprintf - 7.0.0 7.0.0
stack_trace - 1.12.1 1.12.1
stream_channel - 2.1.4 2.1.4
string_scanner - 1.4.1 1.4.1
term_glyph - 1.2.2 1.2.2
tuple - 2.0.2 2.0.2
typed_data - 1.4.0 1.4.0
uuid - 4.5.1 4.5.1
web - 0.5.1 1.1.1
web_socket_channel - 2.4.5 3.0.3
yaml - 3.1.3 3.1.3

To reproduce run dart pub outdated --no-dev-dependencies --up-to-date --no-dependency-overrides.

The constraint `^1.72.1` on flutter_rust_bridge does not support the stable version `2.0.0`.

Try running dart pub upgrade --major-versions flutter_rust_bridge to update the constraint.

Passed check 10/10 points: Package supports latest stable Dart and Flutter SDKs

Passed check 20/20 points: Compatible with dependency constraint lower bounds

pub downgrade does not expose any static analysis error.

Analyzed with Pana 0.22.20, Dart 3.7.2.

Check the analysis log for details.

Weekly downloads

Display as:
By versions:
1
likes
80
points
290
downloads

Publisher

verified publishersimonwang.dev

Weekly Downloads

The implementation of BPE algorithm for sentence encode/decode

Documentation

API reference

License

MIT (license)

Dependencies

ffi, flutter_rust_bridge, meta

More

Packages that depend on gpt_tokenizer