A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Compile Dependencies (0)
| Category/License | Group / Artifact | Version | Updates |
|---|
Test Dependencies (5)
| Category/License | Group / Artifact | Version | Updates | |
|---|---|---|---|---|
Assertion
Apache 2.0
|  | org.assertj
»
assertj-core Rich and fluent assertions for testing in Java | 3.27.7 | ✔ |
Testing
EPL 2.0
|  | org.junit.jupiter
»
junit-jupiter Module "junit-jupiter" of JUnit | 6.0.3 | 6.1.3 |
Testing
EPL 2.0
| | org.junit.jupiter
»
junit-jupiter-api JUnit Jupiter is the API for writing tests using JUnit 5. | 6.0.3 | 6.1.3 |
Testing
EPL 2.0
| | org.junit.jupiter
»
junit-jupiter-engine Core package for the JUnit Jupiter test engine. | 6.0.3 | 6.1.3 |
Testing
EPL 2.0
| | org.junit.jupiter
»
junit-jupiter-params JUnit Jupiter extension for running parameterized tests. | 6.0.3 | 6.1.3 |