| <!-- ### quantize_version: 2 --> | |
| <!-- ### output_tensor_quantised: 1 --> | |
| <!-- ### convert_type: hf --> | |
| <!-- ### vocab_type: --> | |
| <!-- ### tags: nicoboss --> | |
| weighted/imatrix quants of https://huggingface.co/vicgalle/Roleplay-Hermes-3-Llama-3.1-8B | |
| <!-- ### quantize_version: 2 --> | |
| <!-- ### output_tensor_quantised: 1 --> | |
| <!-- ### convert_type: hf --> | |
| <!-- ### vocab_type: --> | |
| <!-- ### tags: nicoboss --> | |
| weighted/imatrix quants of https://huggingface.co/vicgalle/Roleplay-Hermes-3-Llama-3.1-8B | |