base_model: allenai/OLMo-7B-0424-hf | |
license: apache-2.0 | |
language: | |
- en | |
pipeline_tag: text2text-generation | |
tags: | |
- olmo | |
quantized_by: robolamp | |
Quantized versions of https://huggingface.co/allenai/OLMo-7B-0424-hf | |
**NB**: *Q8_K* is not supported by default llama.cpp, use *Q8_0* instead. | |
bits per weight vs size plot: | |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/63af30a6874f03948c8e3d82/-bUdp3RGswnueD3jFiLLO.png) | |
TODO: readme |