A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version0.10.2compared with

Version Details

Test Changes (3)

0.10.1 0.10.2
ChangeGroup / ArtifactPreviousCurrent
~ Updated org.junit.jupiter » junit-jupiter-api6.0.16.0.2
~ Updated org.junit.jupiter » junit-jupiter-engine6.0.16.0.2
~ Updated org.junit.jupiter » junit-jupiter-params6.0.16.0.2