Inference Node — runs on each GPU machine, cuBLAS SGEMM via Panama FFI, pipeline forward pass, gRPC activation transfer

Artifacts using Node (3)
Sort by:Popular

Tokenizer — DJL SentencePiece wrapper, chat template formatter, BPE support for LLaMA 2/3, Mistral, Gemma
Last Release on Jun 20, 2026
Coordinator and Scheduler — continuous batching, leader election, gRPC streaming, Java 25 virtual threads
Last Release on Jun 20, 2026
Juno-master standalone coordinator entry point. Full-cluster tests.
Last Release on Jun 20, 2026
  • Prev
  • 1
  • Next