chargoddard commited on
Commit
da911da
1 Parent(s): 53eb30b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -19,4 +19,14 @@ Still evaluating, don't get too excited! Might be incredibly dumb. Check out the
19
  | - humanities |N/A |none | 0|acc |0.6582|± |0.0063|
20
  | - other |N/A |none | 0|acc |0.7927|± |0.0069|
21
  | - social_sciences|N/A |none | 0|acc |0.8466|± |0.0064|
22
- | - stem |N/A |none | 0|acc |0.6702|± |0.0079|
 
 
 
 
 
 
 
 
 
 
 
19
  | - humanities |N/A |none | 0|acc |0.6582|± |0.0063|
20
  | - other |N/A |none | 0|acc |0.7927|± |0.0069|
21
  | - social_sciences|N/A |none | 0|acc |0.8466|± |0.0064|
22
+ | - stem |N/A |none | 0|acc |0.6702|± |0.0079|
23
+
24
+ 5-shot:
25
+
26
+ | Groups |Version|Filter|n-shot|Metric|Value | |Stderr|
27
+ |------------------|-------|------|-----:|------|-----:|---|-----:|
28
+ |mmlu |N/A |none | 0|acc |0.7669|± |0.0034|
29
+ | - humanities |N/A |none | 5|acc |0.7296|± |0.0062|
30
+ | - other |N/A |none | 5|acc |0.8101|± |0.0067|
31
+ | - social_sciences|N/A |none | 5|acc |0.8668|± |0.0060|
32
+ | - stem |N/A |none | 5|acc |0.6825|± |0.0079|