EmbeddedLLM/Meta-Llama-3.1-8B-Instruct-int4-sym-ov
Updated
OpenVINO GenAI
-
-
EmbeddedLLM/Phi-3-mini-4k-instruct-int4-sym-ov
Updated -
OpenVINO/Phi-3-mini-4k-instruct-int8-ov
Text Generation • Updated • 25 -
EmbeddedLLM/Phi-3-mini-128k-instruct-int4-sym-ov
Updated -
OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation • Updated • 176 • 3 -
EmbeddedLLM/Phi-3-medium-4k-instruct-int4-sym-ov
Updated -
OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation • Updated • 33 -
EmbeddedLLM/Phi-3-medium-128k-instruct-int4-sym-ov
Updated • 1 -
EmbeddedLLM/Qwen2-7B-Instruct-int4-sym-ov
Updated • 1 -
OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation • Updated • 651 • 1 -
OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation • Updated • 205 • 1 -
EmbeddedLLM/Mistral-7B-Instruct-v0.3-int4-sym-ov
Updated -
OpenVINO/open_llama_3b_v2-int8-ov
Text Generation • Updated • 298 • 1 -
OpenVINO/open_llama_7b_v2-int4-ov
Text Generation • Updated • 29 -
OpenVINO/open_llama_7b_v2-int8-ov
Text Generation • Updated • 54 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov
Text Generation • Updated • 216 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov
Text Generation • Updated • 208 -
EmbeddedLLM/neural-chat-7b-v1-1-int4-sym-ov
Updated -
OpenVINO/neural-chat-7b-v1-1-int8-ov
Text Generation • Updated • 6 -
OpenVINO/starcoder2-15b-int4-ov
Text Generation • Updated • 47 -
OpenVINO/starcoder2-15b-int8-ov
Text Generation • Updated • 23 -
OpenVINO/persimmon-8b-chat-int4-ov
Text Generation • Updated • 16 -
OpenVINO/persimmon-8b-chat-int8-ov
Text Generation • Updated • 5 -
EmbeddedLLM/RedPajama-INCITE-Instruct-3B-v1-int4-sym-ov
Updated -
EmbeddedLLM/Llama-3.2-1B-Instruct-int4-sym-ov
Updated -
EmbeddedLLM/Llama-3.2-3B-Instruct-int4-sym-ov
Updated -
EmbeddedLLM/Llama-Guard-3-1B-int4-sym-ov
Updated • 2