Lambent commited on
Commit
1faf62d
·
verified ·
1 Parent(s): 8d4a94d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -52,6 +52,12 @@ hf (pretrained=tiiuae/Falcon3-10B-Base,dtype=auto,trust_remote_code=True), gen_k
52
  |eq_bench| 2.1|none | 0|eqbench |↑ | 60.9913|± |2.2402|
53
  | | |none | 0|percent_parseable|↑ |100.0000|± |0.0000|
54
 
 
 
 
 
 
 
55
  hf (pretrained=tiiuae/Falcon3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
56
  | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
57
  |-------------|------:|------|-----:|--------|---|-----:|---|-----:|
 
52
  |eq_bench| 2.1|none | 0|eqbench |↑ | 60.9913|± |2.2402|
53
  | | |none | 0|percent_parseable|↑ |100.0000|± |0.0000|
54
 
55
+ hf (pretrained=tiiuae/Falcon3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4
56
+ |Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
57
+ |-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
58
+ |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.8188|± |0.0106|
59
+ | | |strict-match | 5|exact_match|↑ |0.8105|± |0.0108|
60
+
61
  hf (pretrained=tiiuae/Falcon3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
62
  | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
63
  |-------------|------:|------|-----:|--------|---|-----:|---|-----:|