Tokenizer — DJL SentencePiece wrapper, chat template formatter,
BPE support for LLaMA 2/3, Mistral, Gemma
This artifact is declared in 1 BOMs
Licenses
| License | URL |
|---|---|
| Apache License, Version 2.0 | https://www.apache.org/licenses/LICENSE-2.0.txt |
Developers
| Name | Dev Id | Roles | Organization | |
|---|---|---|---|---|
| Juno Team | | Machine Learning Cabinet |