A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version2.6.0compared with
Version Details
| 2.5.0 | 2.6.0 | |
|---|---|---|
| Release date | Jul 31, 2026 | Aug 06, 2026 |
| Licenses | Apache 2.0 | Apache 2.0 |
| Vulnerabilities | None | None |
No dependency changes compared to the selected version.