Back to all repositories
RU
atomr-infer
by rustakka
Multi-runtime GPU + remote inference as a supervised actor system on atomr. OpenAI / Anthropic / Gemini / LiteLLM remote runtimes + vLLM / TensorRT / ORT / mistral.rs local; remote-only build compiles zero GPU deps.
1stars0forks0watchers/subscribers5issues
actor-modelactorsagentic-systemsakkaanthropicconcurrencydistributed-systemsgeminiinferencellmopenairustvllm
- Language
- Rust
- Size
- 1.2 MB
- Created
- May 3, 2026
- Last Updated
- Jul 29, 2026
- Last Pushed
- May 17, 2026
Available Plugins
Loading plugins...
Evaluate before installing
- Review the source repository, recent maintenance, and license on GitHub.
- Read the marketplace manifest and plugin source files before running commands.
- Start with the smallest required permission set and validate behavior in a safe environment.