A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version1.0.0compared with

Version Details

Test Changes (1)

0.10.7 1.0.0
ChangeGroup / ArtifactPreviousCurrent
+ Added org.junit.jupiter » junit-jupiter-6.0.3