Skip to main content
Back to all repositories

Unified CLI for local LLM serving — llama.cpp + TurboQuant GGUF, OpenAI-compatible HTTP. Plugs into roxabi-factory over NATS.

1stars0forks0watchers/subscribers4issues
agplclillama-cppllmnatsopen-sourcepythonroxabiself-hostable
Language
Python
License
GNU Affero General Public License v3.0
Size
1.2 MB
Created
Apr 18, 2026
Last Updated
Aug 10, 2026
Last Pushed
Aug 10, 2026

Available Plugins

Loading plugins...

Evaluate before installing

  1. Review the source repository, recent maintenance, and license on GitHub.
  2. Read the marketplace manifest and plugin source files before running commands.
  3. Start with the smallest required permission set and validate behavior in a safe environment.