tokenizer
Sort by:Popular▼

1.DJL NLP Utilities For Huggingface Tokenizers90 usages

ai.djl.huggingface » tokenizers Apache

Deep Java Library (DJL) NLP utilities for Huggingface tokenizers
Last Release on Sep 10, 2026

2.JTokkit149 usages

com.knuddels » jtokkit MIT

JTokkit is a Java tokenizer library designed for use with OpenAI models.
Last Release on Jul 19, 2024

3.NLP Tokenizer JVM50 usages

ai.grazie.nlp » nlp-tokenizer-jvm

NLP Tokenizer JVM
Last Release on Aug 17, 2026

4.NLP Tokenizer31 usages

ai.grazie.nlp » nlp-tokenizer

NLP Tokenizer
Last Release on Aug 17, 2026

5.Anorm Tokenizer5 usages

org.playframework.anorm » anorm-tokenizer Apache

anorm-tokenizer
Last Release on Jun 15, 2026

6.NLP Tokenizer JS31 usages

ai.grazie.nlp » nlp-tokenizer-js

NLP Tokenizer JS
Last Release on Aug 17, 2026

7.ML LLM Tokenizer6 usages

com.jetbrains.intellij.ml » ml-llm-tokenizer

ML LLM Tokenizer
Last Release on Sep 2, 2026

8.DJL NLP Utilities For SentencePiece5 usages

ai.djl.sentencepiece » sentencepiece Apache

Deep Java Library (DJL) NLP utilities for SentencePiece
Last Release on Sep 10, 2026

9.Prompt Tokenizer4 usages

ai.koog » prompt-tokenizer-android Apache

Koog is a framework for quickly creating AI agents in Kotlin with minimal effort.
Last Release on Aug 28, 2026

10.Prompt Tokenizer5 usages

com.kreoh.kroog » prompt-tokenizer-jvm Apache

Kroog is a framework for quickly creating AI agents in Kotlin with minimal effort.
Last Release on Sep 10, 2026