torchdistill: Reproducing fine-tuned BERT models - a yoshitomo-matsubara Collection

SRSD: Symbolic Regression for Scientific Discovery

torchdistill: Distilling fine-tuned BERT-Large -> BERT-Base

torchdistill: Reproducing fine-tuned BERT models

updated 22 days ago

GLUE leaderboard: https://gluebenchmark.com/leaderboard/ Code: https://github.com/yoshitomo-matsubara/torchdistill?tab=readme-ov-file#glue

Upvote

yoshitomo-matsubara/bert-base-uncased-mnli

Text Classification • Updated Apr 19 • 72
yoshitomo-matsubara/bert-base-uncased-cola

Text Classification • Updated Apr 19 • 105
yoshitomo-matsubara/bert-base-uncased-rte

Text Classification • Updated Apr 19 • 58 • 1
yoshitomo-matsubara/bert-base-uncased-stsb

Text Classification • Updated Apr 19 • 20
yoshitomo-matsubara/bert-base-uncased-qnli

Text Classification • Updated Apr 19 • 34
yoshitomo-matsubara/bert-base-uncased-sst2

Text Classification • Updated Apr 19 • 33
yoshitomo-matsubara/bert-base-uncased-mrpc

Text Classification • Updated Apr 19 • 41
yoshitomo-matsubara/bert-base-uncased-qqp

Text Classification • Updated Apr 19 • 40
yoshitomo-matsubara/bert-base-uncased-wnli

Text Classification • Updated Apr 19 • 8
yoshitomo-matsubara/bert-large-uncased-qqp

Text Classification • Updated Apr 19 • 33
yoshitomo-matsubara/bert-large-uncased-mnli

Text Classification • Updated Apr 19 • 46
yoshitomo-matsubara/bert-large-uncased-sst2

Text Classification • Updated Apr 19 • 43
yoshitomo-matsubara/bert-large-uncased-rte

Text Classification • Updated Apr 19 • 59
yoshitomo-matsubara/bert-large-uncased-cola

Text Classification • Updated Apr 19 • 77 • 1
yoshitomo-matsubara/bert-large-uncased-qnli

Text Classification • Updated Apr 19 • 38
yoshitomo-matsubara/bert-large-uncased-mrpc

Text Classification • Updated Apr 19 • 80
yoshitomo-matsubara/bert-large-uncased-stsb

Text Classification • Updated Apr 19 • 13
yoshitomo-matsubara/bert-large-uncased-wnli

Text Classification • Updated Apr 19 • 9

Upvote