Pure Java 21+ CPU inference (continuous batching, paged KV cache, safetensors / GGUF / ONNX): chat, BERT embeddings, Whisper speech-to-text, and Piper text-to-speech. Inspired by GeeeekExplorer/nano-vllm

Latest Versions

4 versions โ†’
Version โ–ผVulnerabilitiesUsagesDate
1.3.x
1.3.0
0
Aug 30, 2026
1.2.x
1.2.0
0
Aug 23, 2026
1.1.x
1.1.0
0
Aug 17, 2026
1.0.x
1.0.0
0
Aug 10, 2026
4 versions โ†’