JHC04567 commited on
Commit
9efc0fb
·
verified ·
1 Parent(s): 1aee8a1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -106,12 +106,12 @@ print("BLOCKED" if unsafe_prob >= 0.85 else "PASSED")
106
  ## Evaluation
107
 
108
  Attacks: `benign request + conjunction + hidden injection` (real deepset/Gandalf payloads).
109
-
110
- Split pipeline vs. same classifier at matched recall (0.94).
111
  | Mode | Precision | Recall | F1 |
112
  |:-----|----------:|-------:|---:|
113
  | Classifier @ matched recall | 0.85 | 0.94 | — |
114
  | **Pipeline (split)** | **0.98** | 0.94 | **0.96** |
 
115
  Splitting wins: +0.14 precision at matched recall (PR-AUC 0.97), rescuing +84 of 300 attacks with 0 added false positives.
116
 
117
  *Caveats:* near-best-case (split on SPID's own conjunctions); payloads overlap training data; small benign control (n=150).
 
106
  ## Evaluation
107
 
108
  Attacks: `benign request + conjunction + hidden injection` (real deepset/Gandalf payloads).
109
+ Split pipeline vs. same classifier at matched recall(0.94).
 
110
  | Mode | Precision | Recall | F1 |
111
  |:-----|----------:|-------:|---:|
112
  | Classifier @ matched recall | 0.85 | 0.94 | — |
113
  | **Pipeline (split)** | **0.98** | 0.94 | **0.96** |
114
+
115
  Splitting wins: +0.14 precision at matched recall (PR-AUC 0.97), rescuing +84 of 300 attacks with 0 added false positives.
116
 
117
  *Caveats:* near-best-case (split on SPID's own conjunctions); payloads overlap training data; small benign control (n=150).