Inference Node — runs on each GPU machine, cuBLAS SGEMM via
Panama FFI, pipeline forward pass, gRPC activation transfer
Artifacts using Node (3)
Tokenizer — DJL SentencePiece wrapper, chat template formatter,
BPE support for LLaMA 2/3, Mistral, Gemma
Last Release on Jun 20, 2026
2.Coordinator
cab.ml » coordinator Apache
Coordinator and Scheduler — continuous batching, leader
election, gRPC streaming, Java 25 virtual threads
Last Release on Jun 20, 2026
3.Juno Master
cab.ml » juno-master Apache
Juno-master standalone coordinator entry point.
Full-cluster tests.
Last Release on Jun 20, 2026
- Prev
- 1
- Next