Update README.md
Browse files
README.md
CHANGED
@@ -52,6 +52,12 @@ hf (pretrained=tiiuae/Falcon3-10B-Base,dtype=auto,trust_remote_code=True), gen_k
|
|
52 |
|eq_bench| 2.1|none | 0|eqbench |↑ | 60.9913|± |2.2402|
|
53 |
| | |none | 0|percent_parseable|↑ |100.0000|± |0.0000|
|
54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
hf (pretrained=tiiuae/Falcon3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
|
56 |
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
57 |
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|
|
|
52 |
|eq_bench| 2.1|none | 0|eqbench |↑ | 60.9913|± |2.2402|
|
53 |
| | |none | 0|percent_parseable|↑ |100.0000|± |0.0000|
|
54 |
|
55 |
+
hf (pretrained=tiiuae/Falcon3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4
|
56 |
+
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|
57 |
+
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|
58 |
+
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.8188|± |0.0106|
|
59 |
+
| | |strict-match | 5|exact_match|↑ |0.8105|± |0.0108|
|
60 |
+
|
61 |
hf (pretrained=tiiuae/Falcon3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
|
62 |
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
63 |
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|