metadata
license: mit
language:
- en
tags:
- uncertainty-detection
- social-media
- text-classification
widget:
- text: It seems like Bitcoin prices are heading into bearish territory.
example_title: Hedge Detection (Positive - Label 1)
- text: Bitcoin prices have fallen by 42% in the last 30 days.
example_title: Hedge Detection (Negative - Label 0)
Overview
Fine tuned VinAI's BERTweet base model on the Wiki Weasel 2.0 Corpus from the Szeged Uncertainty Corpus for hedge (linguistic uncertainty) detection in social media texts. Model was trained and optimised using Ray Tune's implementation of Deep Mind's Population Based Training with the arithmetic mean of Accuracy & F1 as its evaluation metric.
Labels
- LABEL_1 = Positive (Hedge is detected within text)
- LABEL_0 = Negative (No Hedges detected within text)
Model Performance
| Model | Accuracy | F1-Score | Accuracy & F1-Score |
|---|---|---|---|
BERTweet-Hedge |
0.9680 | 0.8765 | 0.9222 |