robolamp's picture
Update README.md
4f77e76 verified
---
base_model: allenai/OLMo-7B-0424-hf
license: apache-2.0
language:
- en
pipeline_tag: text2text-generation
tags:
- olmo
quantized_by: robolamp
---
Quantized versions of https://huggingface.co/allenai/OLMo-7B-0424-hf
**NB**: *Q8_K* is not supported by default llama.cpp, use *Q8_0* instead.
bits per weight vs size plot:
![image/png](https://cdn-uploads.huggingface.co/production/uploads/63af30a6874f03948c8e3d82/-bUdp3RGswnueD3jFiLLO.png)
TODO: readme