Hugging Face's logo

fakezeta
/
openchat-3.5-0106-openvino-int8

Text Generation
Transformers
OpenVINO
mistral
openchat
conversational
Inference Endpoints
Model card Files Community

OpenVINO INT8 converted model from https://huggingface.co/openchat/openchat-3.5-0106/

Downloads last month
7
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including fakezeta/openchat-3.5-0106-openvino-int8