Updated README

README.md

@@ -14,7 +14,7 @@ base_model:
 ---
 
 
-# JAIS Initiative: Atlas-Chat Model Card
+# JAIS Intiative: Atlas-Chat Models
 
 
 ## Model Overview
@@ -317,6 +317,7 @@ The Atlas-Chat models were evaluated on a comprehensive suite of tasks using var
 * **DarijaMMLU:** A Darija version of ArabicMMLU and MMLU benchmarks translated from MSA and English respectively.
 * **DarijaHellaSwag:** A Darija version of HellaSwag.
 * **Belebele Ary_Arab:** Belebele is a multiple-choice machine reading comprehension dataset published by Facebook spanning 122 language variants. The Evaluation is done on the Ary_Arab part of Belebele that refers to Darija.
+* **DarijaAlpacaEval:** A Darija version of AlpacaEval translated to Darija and adapted to the Moroccan culture.
 * **Sentiment Analysis.**
 * **Translation:** Including six directions and four languages: Darija, MSA, English and French.
 * **Transliteration:** Transforming a sentence from Darija (written in Arabic characters) to Arabizi (Written in Latin characters) and vice-versa.
@@ -331,42 +332,49 @@ The models were compared against a collection of existing open-source Arabic mod
         <td><a href="https://huggingface.co/datasets/MBZUAI-Paris/DarijaMMLU" target="_blank">DarijaMMLU</a></td>
         <td><a href="MBZUAI-Paris/DarijaHellaSwag" target="_blank">DarijaHellaSwag</a></td>
         <td ><a href="https://huggingface.co/datasets/facebook/belebele/viewer/ary_Arab" target="_blank">Belebele Ary</a></td>
+        <td ><a href="https://huggingface.co/datasets/MBZUAI-Paris/DarijaAlpacaEval" target="_blank">DarijaAlpacaEval</a></td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/inceptionai/jais-family-1p3b-chat" target="_blank">jais-family-1p3b-chat</a></td>
         <td>35.39</td>
         <td>32.51</td>
         <td>38.33</td>
+        <td>35.56</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/inceptionai/jais-family-2p7b-chat" target="_blank">jais-family-2p7b-chat</a></td>
         <td>37.44</td>
         <td>34.49</td>
         <td>44.11</td>
+        <td>52.97</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/google/gemma-2-2b-it" target="_blank">gemma-2-2b-it</a></td>
         <td>28.58</td>
         <td>32.42</td>
         <td>25.22</td>
+        <td>58.67</td>
     </tr>
     <tr>
         <td><a href="meta-llama/Llama-3.2-1B-Instruct" target="_blank">Llama-3.2-1B-Instruct</a></td>
         <td>27.66</td>
         <td>26.88</td>
         <td>28.89</td>
+        <td>23.57</td>
     </tr>
     <tr>
         <td><a href="meta-llama/Llama-3.2-3B-Instruct" target="_blank">Llama-3.2-3B-Instruct</a></td>
         <td>32.60</td>
         <td>28.33</td>
         <td>38.00</td>
+        <td>47.62</td>
     </tr>
     <tr>
         <td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-2B" target="_blank">Atlas-Chat-2B</a></strong></td>
-        <td><b>44.97</td>
-        <td><b>41.48</td>
-        <td><b>53.89</td>
+        <td><b>44.97</b></td>
+        <td><b>41.48</b></td>
+        <td><b>53.89</b></td>
+        <td><b>92.31</b></td>
     </tr>
     <tr style="border-top: 4px solid;"></tr>
     <tr>
@@ -374,54 +382,63 @@ The models were compared against a collection of existing open-source Arabic mod
         <td>39.96</td>
         <td>41.57</td>
         <td>51.22</td>
+        <td>65.18</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/inceptionai/jais-adapted-7b-chat" target="_blank">jais-adapted-7b-chat</a></td>
         <td>39.30</td>
         <td>35.19</td>
         <td>43.67</td>
+        <td>61.84</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/inceptionai/jais-family-13b-chat" target="_blank">jais-family-13b-chat</a></td>
         <td>45.11</td>
         <td>43.90</td>
         <td>58.67</td>
+        <td>69.93</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/inceptionai/jais-adapted-13b-chat" target="_blank">jais-adapted-13b-chat</a></td>
         <td>45.20</td>
         <td>40.65</td>
         <td>49.67</td>
+        <td>77.52</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/FreedomIntelligence/AceGPT-7B-chat" target="_blank">AceGPT-7b-chat</a></td>
         <td>35.98</td>
         <td>36.57</td>
         <td>30.11</td>
+        <td>47.31</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/FreedomIntelligence/AceGPT-13B-chat" target="_blank">AceGPT-13b-chat</a></td>
         <td>41.09</td>
         <td>38.35</td>
         <td>33.11</td>
+        <td>52.79</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/google/gemma-2-9b-it" target="_blank">gemma-2-9b-it</a></td>
         <td>35.91</td>
         <td>42.43</td>
         <td>31.00</td>
+        <td>90.86</td>
     </tr>
     <tr>
         <td><a href="meta-llama/Meta-Llama-3.1-8B-Instruct" target="_blank">Llama-3.1-8B-Instruct</a></td>
         <td>44.13</td>
         <td>38.24</td>
         <td>47.00</td>
+        <td>78.08</td>
     </tr>
     <tr>
         <td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-9B" target="_blank">Atlas-Chat-9B</a></strong></td>
-        <td><b>58.23</td>
-        <td><b>57.75</td>
-        <td><b>74.56</td>
+        <td><b>58.23</b></td>
+        <td><b>57.75</b></td>
+        <td><b>74.56</b></td>
+        <td><b>95.62</b></td>
     </tr>
     <tr style="border-top: 4px solid;"></tr>
     <tr>
@@ -429,22 +446,22 @@ The models were compared against a collection of existing open-source Arabic mod
         <td>51.88</td>
         <td>35.61</td>
         <td>65.67</td>
+        <td>24.64</td>
     </tr>
     <tr>
         <td><a href="https://huggingface.co/google/gemma-2-27b-it" target="_blank">gemma-2-27b-it</a></td>
         <td>36.47</td>
         <td>37.04</td>
         <td>35.78</td>
+        <td>95.07</td>
     </tr>
     <tr>
         <td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-27B" target="_blank">Atlas-Chat-27B</a></strong></td>
-        <td><b>61.95</td>
-        <td><b>48.37</td>
-        <td><b>75.67</td>
+        <td><b>61.95</b></td>
+        <td><b>48.37</b></td>
+        <td><b>75.67</b></td>
+        <td><b>96.58</b></td>
     </tr>
-
-
-    
 </table>
 
 **Standard NLP Tasks:**