aisingapore
/

sea-lion-3b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

dotw commited on Oct 30, 2023

Commit

d9f30d9

•

1 Parent(s): 48911f4

Update README.md

Files changed (1) hide show

README.md +5 -2

README.md CHANGED Viewed

@@ -160,8 +160,11 @@ _Coming soon_
 <!-- These are the evaluation metrics being used, ideally with a description of why. -->
-_Coming soon_
-LLM Eval Benchmarks, no BHASA
 ### Results

 <!-- These are the evaluation metrics being used, ideally with a description of why. -->
+| Model       | Average |  ARC  | HellaSwag |  MMLU | TruthfulQA |
+|-------------|---------|-------|-----------|-------|------------|
+| SEA LION 3B |  40.35  | 36.26 |   64.60   | 24.07 |   36.47    |
+| SEA LION 7B |  42.60  | 39.93 |   68.51   | 26.87 |   35.09    |
 ### Results