🛡 Detection coverage — what this tool actually inspects
A grounded map of what each detector sees. The probe count, output-firewall rule list, and recognised codecs below are read live from the running code, so this page stays accurate as the tool changes — it is a measurement, not a marketing claim.
📚 Recognized harm taxonomies — and how this tool relates to them
Read this framing first. The benchmarks below — NVIDIA Aegis 2.0 and PKU-Alignment BeaverTails — are harm-content taxonomies: they classify what a response says (violence, self-harm, privacy, and so on). This tool measures something different: whether an attack technique (prompt injection, encoding, multi-turn escalation, tool-descriptor poisoning) can bypass a guard, tested with a benign canary objective — never by trying to elicit harmful content. So these taxonomies describe the space a real attacker's technique would be aimed at; they are not categories this tool generates, tests for, or scores against. We deliberately do not relabel the benign technique-probes as harm categories: that mislabel would overstate what the tool measures, which is exactly the security theater this project avoids. They are listed as recognized reference frameworks — and because one of them directly informs a feature here.
NVIDIA Aegis 2.0 (Nemotron Content Safety Dataset V2)
12 core hazard categories plus 9 fine-grained risks, informed by the MLCommons AI Safety Benchmark, Llama Guard, and the OpenAI / Perspective moderation taxonomies. NAACL 2025 · CC-BY-4.0.
Hate / Identity HateSexualSuicide & Self-HarmViolenceGuns / Illegal WeaponsThreatPII / PrivacySexual (Minor)Criminal Planning / ConfessionsHarassmentControlled / Regulated SubstancesProfanityOther
Fine-grained (standardized from free-text annotation):
Illegal ActivityImmoral / UnethicalUnauthorized AdvicePolitical / Misinformation / ConspiracyFraud / DeceptionCopyright / Trademark / PlagiarismHigh-Risk Gov. Decision MakingMalwareManipulation
PKU-Alignment BeaverTails
14 harm categories over 300k+ human-labeled QA pairs. Uniquely separates helpfulness from harmlessness via QA-moderation (risk-neutralization), rather than a single toxicity score. NeurIPS 2023 · CC-BY-NC-4.0.
Animal AbuseChild AbuseControversial Topics / PoliticsDiscrimination / Stereotype / InjusticeDrug Abuse / Weapons / Banned SubstanceFinancial Crime / Property Crime / TheftHate Speech / Offensive LanguageMisinformation re: Ethics, Laws & SafetyNon-Violent Unethical BehaviorPrivacy ViolationSelf-HarmSexually Explicit / Adult ContentTerrorism / Organized CrimeViolence / Aiding & Abetting / Incitement
Honest connection point: the Refusal quality (helpfulness) classifier shown on resisted probes in the suite results — graceful-redirect vs hard-refusal — is directly inspired by BeaverTails' helpfulness/harmlessness separation: a model that refuses safely and stays helpful is rated better than one that hard-stops. As noted there, that classifier is a heuristic, not an LLM judge.