Classifies locution based on their illocutionary force intents:

"0": "Agreeing",  
"1": "Arguing",  
"2": "Asserting",  
"3": "Assertive Questioning",  
"4": "Challenging",  
"5": "Default Illocuting",  
"6": "Disagreeing",  
"7": "Pure Questioning",  
"8": "Restating",  
"9": "Rhetorical Questioning"  

F1_macro - 0.55

F1_weighted - 0.67

Accuracy - 0.67

Dataset:

MM2012 - https://corpora.aifdb.org/mm2012

MM123 - https://corpora.aifdb.org/mm123

QT30 - https://corpora.aifdb.org/qt30

US2016 - https://corpora.aifdb.org/US2016

precision recall f1-score support
Agreeing 0.63 0.67 0.65 18
Arguing 0.67 0.40 0.50 5
Asserting 0.79 0.89 0.84 200
Assertive Questioning 0.52 0.44 0.48 124
Challenging 0.48 0.42 0.44 24
Default Illocuting 1.00 0.07 0.13 14
Disagreeing 0.33 0.40 0.36 5
Pure Questioning 0.75 0.76 0.76 293
Restating 1.00 1.00 1.00 2
Rhetorical Questioning 0.36 0.40 0.38 81
accuracy 0.67 766
macro avg 0.65 0.54 0.55 766
weighted avg 0.67 0.67 0.67 766
Downloads last month
17
Safetensors
Model size
355M params
Tensor type
I64
·
F32
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.