neuralmagic
/

OpenHermes-2.5-Mistral-7B-marlin

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

OpenHermes-2.5-Mistral-7B-marlin / quantize_config.json

Commit History

Upload folder using huggingface_hub

e8c8a9f
verified

robertgshaw2 commited on Mar 6