A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version0.7.4compared with

Version Details

Test Changes (1)

0.7.3 0.7.4
ChangeGroup / ArtifactPreviousCurrent
~ Updated org.assertj » assertj-core3.27.43.27.5