A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version0.7.5compared with

Version Details

Test Changes (1)

0.7.4 0.7.5
ChangeGroup / ArtifactPreviousCurrent
~ Updated org.assertj » assertj-core3.27.53.27.6