A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version0.4.9compared with
Version Details
| 0.4.8 | 0.4.9 | |
|---|---|---|
| Release date | Jul 21, 2025 | Jul 25, 2025 |
| Licenses | Apache 2.0 | Apache 2.0 |
| Vulnerabilities | None | None |
No dependency changes compared to the selected version.