Skip to main content
Back to all repositories

Zero-LLM deterministic jailbreak regression benchmark: runs a repeatable battery of known-pattern attacks against an LLM endpoint and scores refusal/partial/compliance across runs. Catch when a model or prompt update silently got weaker. Single-turn, responsible-use. pip install hermes-jailbench

4stars2forks0watchers/subscribers0issues
ai-red-teamai-reliabilityai-safetybenchmarkclaude-code-plugindeterministic-testinggemini-cli-extensiongithub-actionshermes-labsjailbreakjailbreak-detectionllmllm-evaluationllm-securityprompt-injectionprompt-securitypythonred-teamred-teamingregression-testing
Language
Python
License
MIT License
Size
632 KB
Created
Apr 17, 2026
Last Updated
Sep 18, 2026
Last Pushed
Sep 18, 2026

Available Plugins

Loading plugins...

Evaluate before installing

  1. Review the source repository, recent maintenance, and license on GitHub.
  2. Read the marketplace manifest and plugin source files before running commands.
  3. Start with the smallest required permission set and validate behavior in a safe environment.