A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version0.4.7compared with
Version Details
| 0.4.6 | 0.4.7 | |
|---|---|---|
| Release date | Jul 11, 2025 | Jul 19, 2025 |
| Licenses | Apache 2.0 | Apache 2.0 |
| Vulnerabilities | None | None |
No dependency changes compared to the selected version.