Pure Java 21+ CPU LLM inference library (continuous batching, paged KV cache), inspired by GeeeekExplorer/nano-vllm

Latest Versions

1 versions โ†’
VersionVulnerabilitiesUsagesDate
1.0.x
1.0.0
0
Aug 10, 2026
1 versions โ†’