tiktoken_tokenizer_gpt4o_o1 1.2.0 
tiktoken_tokenizer_gpt4o_o1: ^1.2.0 copied to clipboard
glasberg.devOpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.
We analyzed this package 7 days ago, and awarded it 130 pub points (of a possible 160):
10/10 points: Provide a valid pubspec.yaml
5/5 points: Provide a valid README.md
5/5 points: Provide a valid CHANGELOG.md
10/10 points: Use an OSI-approved license
Detected license: BSD-2-Clause.
0/10 points: 20% or more of the public API has dartdoc comments
OUT: Resolving dependencies... Downloading packages...
- _fe_analyzer_shared 91.0.0 (was 91.0.0) (93.0.0 available)
- analyzer 8.4.1 (was 8.4.1) (10.0.0 available)
- args 2.7.0 (was 2.7.0)
- async 2.13.0 (was 2.13.0)
- collection 1.19.1 (was 1.19.1)
- convert 3.1.2 (was 3.1.2)
- crypto 3.0.7 (was 3.0.7)
- csslib 1.0.2 (was 1.0.2)
[18 more lines]
ERR:
The current activation of
dartdoccannot resolve to the same set of dependencies.
Try reactivating the package.
flutter pub global activate dartdoc
Failed to update packages.
10/10 points: Package has an example
20/20 points: Supports 6 of 6 possible platforms (iOS, Android, Web, Windows, macOS, Linux)
-
✓ Android
-
✓ iOS
-
✓ Windows
-
✓ Linux
-
✓ macOS
-
✓ Web
0/0 points: WASM compatibility
This package is compatible with runtime wasm, and will be rewarded additional points in a future version of the scoring model.
See https://dart.dev/web/wasm for details.
30/50 points: code has no errors, warnings, lints, or formatting issues
WARNING: A value for optional parameter 'explicitNVocab' isn't ever given.
lib/src/core_bpe_constructor.dart:51:10
╷
51 │ this.explicitNVocab,
│ ^^^^^^^^^^^^^^
╵
To reproduce make sure you are using the lints_core and run flutter analyze lib/src/core_bpe_constructor.dart
INFO: The variable name '_CACHE' isn't a lowerCamelCase identifier.
lib/tiktoken_tokenizer_gpt4o_o1.dart:117:16
╷
117 │ static final _CACHE = <TiktokenEncodingType, TiktokenEncoder>{};
│ ^^^^^^
╵
To reproduce make sure you are using the lints_core and run flutter analyze lib/tiktoken_tokenizer_gpt4o_o1.dart
10/10 points: All of the package dependencies are supported in the latest version
| Package | Constraint | Compatible | Latest | Notes |
|---|---|---|---|---|
characters |
^1.3.0 |
1.4.0 | 1.4.1 |
Transitive dependencies
| Package | Constraint | Compatible | Latest | Notes |
|---|---|---|---|---|
collection |
- | 1.19.1 | 1.19.1 | |
material_color_utilities |
- | 0.11.1 | 0.13.0 | |
meta |
- | 1.17.0 | 1.17.0 | |
vector_math |
- | 2.2.0 | 2.2.0 |
To reproduce run dart pub outdated --no-dev-dependencies --up-to-date --no-dependency-overrides.
10/10 points: Package supports latest stable Dart and Flutter SDKs
20/20 points: Compatible with dependency constraint lower bounds
pub downgrade does not expose any static analysis error.
Analyzed with Pana 0.23.5, Flutter 3.38.5, Dart 3.10.4.
Check the analysis log for details.
Weekly downloads
Metadata
Publisher
Weekly Downloads
Metadata
OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.
Repository (GitHub)
View/report issues
Topics
#tokenizer #openai #gpt #gpt-4o #tiktoken
License
BSD-2-Clause (license)
