xmadai
/

Llama-3.1-8B-Instruct-xMADai-INT4

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Oscar Wu commited on Oct 23, 2024

Commit

c6bd367

·

1 Parent(s): d1867a5

Updated README

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -20,9 +20,9 @@ This repository contains [`meta-llama/Llama-3.1-8B-Instruct`](https://huggingfac
 ## Table 1: xMAD vs. Unsloth vs. Meta
-|                                                                                                                   | MMLU      | *Arc Challenge | *Arc Easy | LAMBADA Standard | LAMBADA OpenAI | *PIQA     | Winogrande | HellaSwag |
 | ----------------------------------------------------------------------------------------------------------------- | --------- | -------------- | --------- | ---------------- | -------------- | --------- | ---------- | --------- |
-| [xmadai/Llama-3.1-8B-Instruct-xMADai-INT4](https://huggingface.co/xmadai/Llama-3.1-8B-Instruct-xMADai-INT4)       | **66.83** | **52.3**       | **82.11** | **65.73**        | **73.3**       | **79.88** | **72.77**  | **58.49** |
 | [unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit) | 65.91     | 51.37          | 80.89     | 63.98            | 71.49          | 79.43     | 73.80      | 58.51     |
 | [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct)                       | 68.05     | 51.71          | 81.9      | 66.18            | 73.55          | 79.87     | 73.72      | 59.10      |

 ## Table 1: xMAD vs. Unsloth vs. Meta
+|                                                                                                                   | MMLU      | Arc Challenge | Arc Easy | LAMBADA Standard | LAMBADA OpenAI | *PIQA     | Winogrande | HellaSwag |
 | ----------------------------------------------------------------------------------------------------------------- | --------- | -------------- | --------- | ---------------- | -------------- | --------- | ---------- | --------- |
+| [xmadai/Llama-3.1-8B-Instruct-xMADai-INT4](https://huggingface.co/xmadai/Llama-3.1-8B-Instruct-xMADai-INT4)       | **66.83** | **52.3**       | **82.11** | **65.73**        | **73.30**       | **79.88** | **72.77**  | **58.49** |
 | [unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit) | 65.91     | 51.37          | 80.89     | 63.98            | 71.49          | 79.43     | 73.80      | 58.51     |
 | [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct)                       | 68.05     | 51.71          | 81.9      | 66.18            | 73.55          | 79.87     | 73.72      | 59.10      |