Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ tags:
|
|
7 |
- fine-tuned
|
8 |
---
|
9 |
|
10 |
-
# Model Card for MPNet Cybersecurity Classifier
|
11 |
|
12 |
This is a fine-tuned MPNet model specialized for classifying cybersecurity threat groups based on textual descriptions of their tactics and techniques.
|
13 |
|
@@ -186,12 +186,17 @@ To be anounced...
|
|
186 |
| Weighted F1 Score | [More Information Needed] |
|
187 |
|
188 |
|
189 |
-
|
190 |
-
|
191 |
-
|
192 |
-
|
193 |
-
|
194 |
-
|
|
|
|
|
|
|
|
|
|
|
195 |
|
196 |
### Single Prediction Example
|
197 |
|
|
|
7 |
- fine-tuned
|
8 |
---
|
9 |
|
10 |
+
# AttackGroup-MPNET - Model Card for MPNet Cybersecurity Classifier
|
11 |
|
12 |
This is a fine-tuned MPNet model specialized for classifying cybersecurity threat groups based on textual descriptions of their tactics and techniques.
|
13 |
|
|
|
186 |
| Weighted F1 Score | [More Information Needed] |
|
187 |
|
188 |
|
189 |
+
## Evaluation Results
|
190 |
+
|
191 |
+
| Model | Embedding Variability | Accuracy |
|
192 |
+
|-----------------------------------------------|-----------------------|----------|
|
193 |
+
| Original MPNet | 0.085554 | 0.9964 |
|
194 |
+
| MLM Fine-tuned MPNet | 0.034983 | 0.6536 |
|
195 |
+
| ** AttackGroup-MPNET ** | 0.193065 | 0.9508 |
|
196 |
+
| SecBERT | 0.591303 | 0.9886 |
|
197 |
+
| ATTACK-BERT | 0.096108 | 0.9678 |
|
198 |
+
| SecureBERT | 0.007100 | 0.4931 |
|
199 |
+
|
200 |
|
201 |
### Single Prediction Example
|
202 |
|