Bakanayatsu
/

NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF

Inference Endpoints

Model card Files Files and versions Community

NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF / README.md

Bakanayatsu's picture

Create README.md

38a128c verified 11 months ago

|

221 Bytes

	---
	tags:
	- laser
	- mistral
	---
	Original Model: https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-laser

	```imatrix -m NeuralHermes-2.5-Mistral-7B-laser-8_0.gguf -f wiki.train.raw -ngl 99 --chunks 1000 -c 512```