A Java and JVM port of llama.cpp using jextract, enabling local large language model (LLM) inference through native foreign function and memory API interop. Natively supports macOS M-series and Linux x86_64 with GPU acceleration. Platform and hardware support (Windows, ARM, CUDA, etc.) can be extended through custom builds.
Version0.3.2compared with
Version Details
| 0.3.1 | 0.3.2 | |
|---|---|---|
| Release date | Jun 20, 2025 | Jun 22, 2025 |
| Licenses | Apache 2.0 | Apache 2.0 |
| Vulnerabilities | None | None |
No dependency changes compared to the selected version.
