Home » cab.ml » tokenizer

Tokenizer

Tokenizer — DJL SentencePiece wrapper, chat template formatter, BPE support for LLaMA 2/3, Mistral, Gemma
LicenseApache 2.0
Tagstokenizer
Ranking
#129737in MvnRepository
HomePage https://ml.cab/juno.html 🔍 Inspect URL
Links

Latest Versions

3 versions →
Version ▼VulnerabilitiesUsagesDate
0.1.x
0.1.1
1
Aug 25, 2026
0.1.0
1
Jun 20, 2026
0.1.0-RC
1
May 27, 2026
3 versions →