MultivexAI commited on
Commit
f660a0a
·
verified ·
1 Parent(s): 945fccf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -15,6 +15,10 @@ Everyday-Language-3B is a language model fine-tuned for generating natural, ever
15
 
16
  This fine-tuning process significantly improves the model's ability to produce coherent, contextually appropriate, and less repetitive text compared to its base version. It aims to better capture the nuances and patterns of typical conversational language.
17
 
 
 
 
 
18
  ## Intended Uses & Limitations
19
 
20
  **Intended Uses:**
 
15
 
16
  This fine-tuning process significantly improves the model's ability to produce coherent, contextually appropriate, and less repetitive text compared to its base version. It aims to better capture the nuances and patterns of typical conversational language.
17
 
18
+ # HellaSwag Benchmark
19
+
20
+ **An evaluation using a non-instruction-following method was performed on HellaSwag (1000 validation samples). By calculating the likelihood of each possible continuation, the model scored ~73.4% accuracy. This reflects its performance as a base text predictor on a commonsense task, separate from its intended use for generating everyday conversational text.**
21
+
22
  ## Intended Uses & Limitations
23
 
24
  **Intended Uses:**