Group: Gravitee Singularitee

Sort by:Popular▼

✓Popular✓Newest

Gravitee Singularitee Inference

Protobuf/gRPC protocol definitions and generated Vert.x gRPC stubs for Singularitee

Domain model for AI inference engines: interfaces, records, enums, pipeline context, evaluators, and registries. Shared across all modules without pulling in gRPC or Vert.x infrastructure.

Reactive Vert.x gRPC client for Singularitee (publish, retire, infer)

Vert.x gRPC server that manages LLM model lifecycle and serves streaming inference

YAML workspace parsing: loads pipeline and model definitions from workspace files. Shared by server (grpc) and client-side pipeline execution.

Remote ModelEngine implementations that proxy calls to a Singularitee server over gRPC. Used for client-side pipeline execution and cross-server model references.

Native OpenAI/Anthropic/Gemini-compatible HTTP/JSON API over Singularitee engines and pipelines

Production entry point: two-level classloader setup (lib/ + lib/ext/) that reflectively loads the container

Spring-based container integrating gravitee-node: SingulariteeContainer, SingulariteeNode, Spring configurations, gRPC server lifecycle

Singularitee - Gravitee's Inference Server: a standalone gRPC server for running LLM inference outside the Gravitee gateway

Standalone deployment: bootstrap, container and distribution modules

Assembles the distribution folder layout: bin/, config/, lib/, lib/ext/, examples/