Quantized versions of https://huggingface.co/allenai/OLMo-7B-0724-hf
Quantized with this tool: https://github.com/aifoundry-org/LlamaQuantizer
- Downloads last month
- 45
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for aifoundry-org/OLMo-7B-0724-hf-Quantized
Base model
allenai/OLMo-7B-0724-hf