A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version2.0.0compared with
Version Details
| 1.3.0 | 2.0.0 | |
|---|---|---|
| Release date | Jun 27, 2026 | Jul 03, 2026 |
| Licenses | Apache 2.0 | Apache 2.0 |
| Vulnerabilities | None | None |
No dependency changes compared to the selected version.