dart_sentencepiece_tokenizer 1.2.1 copy "dart_sentencepiece_tokenizer: ^1.2.1" to clipboard
dart_sentencepiece_tokenizer: ^1.2.1 copied to clipboard

Published 38 days ago • verified publisherbrodykim.work• Latest: 1.3.0
[unknown platforms]
→

Metadata

A lightweight, pure Dart implementation of SentencePiece tokenizer. Supports BPE (Gemma) and Unigram (Llama) algorithms.

More...

-/ -
pub points
181
downloads

This package version is not analyzed. Check the latest stable version for its analysis.

Check the analysis log for details.

Weekly downloads

Display as:
By versions:

← Metadata

3
likes
0
points
181
downloads

Publisher

verified publisherbrodykim.work

Weekly Downloads

Metadata

A lightweight, pure Dart implementation of SentencePiece tokenizer. Supports BPE (Gemma) and Unigram (Llama) algorithms.

Repository (GitHub)
View/report issues

Topics

#nlp #sentencepiece #tokenizer #machine-learning #llm

License

unknown (license)

More

Packages that depend on dart_sentencepiece_tokenizer

Back