metadata
base_model: meta-llama/Meta-Llama-3.1-70B-Instruct
language:
- en
- de
- fr
- it
- pt
- hi
- es
- th
library_name: transformers
license: llama3.1
pipeline_tag: text-generation
tags:
- facebook
- meta
- pytorch
- llama
- llama-3
| Weight Quantization | PPL |
|---|---|
| FP16 | 4.1892 +/- 0.01430 |
| IQ_1S | 8.5005 +/- 0.03298 |
Dataset used for re-calibration: Mix of standard_cal_data
The generated imatrix can be downloaded from imatrix.dat