Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
OpenVINO
's Collections
Image Generation
Speculative Decoding Draft Models
Speech-to-Text
LLM
LLM
updated
2 days ago
Collection of OpenVINO optimized LLMs
Upvote
18
+8
OpenVINO/phi-2-fp16-ov
Text Generation
•
Updated
Nov 5
•
521
•
1
OpenVINO/phi-2-int8-ov
Text Generation
•
Updated
Oct 29
•
59
OpenVINO/mistral-7b-instruct-v0.1-int8-ov
Text Generation
•
Updated
21 days ago
•
869
•
1
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov
Text Generation
•
Updated
Nov 11
•
50
OpenVINO/mistral-7b-instruct-v0.1-int4-ov
Text Generation
•
Updated
Oct 29
•
481
OpenVINO/codegen25-7b-multi-fp16-ov
Text Generation
•
Updated
Nov 5
•
18
OpenVINO/codegen25-7b-multi-int8-ov
Text Generation
•
Updated
Nov 5
•
20
•
1
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov
Text Generation
•
Updated
Nov 5
•
212
•
4
OpenVINO/Mixtral-8x7B-Instruct-v0.1-int8-ov
Text Generation
•
Updated
Nov 5
•
181
•
3
OpenVINO/notus-7b-v1-fp16-ov
Text Generation
•
Updated
Nov 5
•
30
OpenVINO/notus-7b-v1-int8-ov
Text Generation
•
Updated
Nov 5
•
17
OpenVINO/neural-chat-7b-v3-3-fp16-ov
Text Generation
•
Updated
Nov 5
•
21
OpenVINO/neural-chat-7b-v3-3-int8-ov
Text Generation
•
Updated
Nov 5
•
29
OpenVINO/zephyr-7b-beta-int8-ov
Text Generation
•
Updated
Nov 5
•
18
OpenVINO/zephyr-7b-beta-int4-ov
Text Generation
•
Updated
Nov 5
•
24
OpenVINO/dolly-v2-3b-int4-ov
Text Generation
•
Updated
Nov 5
•
350
OpenVINO/dolly-v2-3b-int8-ov
Text Generation
•
Updated
Nov 5
•
30
OpenVINO/dolly-v2-3b-fp16-ov
Text Generation
•
Updated
Nov 5
•
359
OpenVINO/codegen2-3_7B_P-int4-ov
Text Generation
•
Updated
Nov 5
•
14
OpenVINO/codegen2-3_7B_P-fp16-ov
Text Generation
•
Updated
Nov 5
•
15
OpenVINO/zephyr-7b-beta-fp16-ov
Text Generation
•
Updated
Nov 5
•
20
OpenVINO/codegen2-3_7B_P-int8-ov
Text Generation
•
Updated
Nov 5
•
14
•
1
OpenVINO/TinyLlama-1.1B-Chat-v1.0-fp16-ov
Text Generation
•
Updated
Nov 5
•
432
•
1
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov
Text Generation
•
Updated
Oct 31
•
455
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov
Text Generation
•
Updated
Nov 5
•
397
OpenVINO/gpt-neox-20b-int8-ov
Text Generation
•
Updated
Nov 5
•
16
OpenVINO/gpt-neox-20b-fp16-ov
Text Generation
•
Updated
Nov 5
•
26
OpenVINO/gpt-j-6b-int4-ov
Text Generation
•
Updated
Nov 5
•
44
OpenVINO/gpt-j-6b-int8-ov
Text Generation
•
Updated
Nov 5
•
19
OpenVINO/gpt-j-6b-fp16-ov
Text Generation
•
Updated
Nov 5
•
36
OpenVINO/falcon-7b-instruct-int4-ov
Text Generation
•
Updated
Nov 5
•
12
OpenVINO/falcon-7b-instruct-fp16-ov
Text Generation
•
Updated
Nov 5
•
17
OpenVINO/falcon-7b-instruct-int8-ov
Text Generation
•
Updated
Nov 5
•
15
OpenVINO/open_llama_7b_v2-int8-ov
Text Generation
•
Updated
Nov 5
•
18
OpenVINO/open_llama_7b_v2-int4-ov
Text Generation
•
Updated
Nov 5
•
15
OpenVINO/open_llama_7b_v2-fp16-ov
Text Generation
•
Updated
Nov 5
•
39
OpenVINO/open_llama_3b_v2-int8-ov
Text Generation
•
Updated
Oct 29
•
365
•
1
OpenVINO/open_llama_3b_v2-fp16-ov
Text Generation
•
Updated
Nov 5
•
26
OpenVINO/phi-2-int4-ov
Text Generation
•
Updated
Nov 5
•
18
•
1
OpenVINO/neural-chat-7b-v3-3-int4-ov
Text Generation
•
Updated
Nov 5
•
161
OpenVINO/notus-7b-v1-int4-ov
Text Generation
•
Updated
Nov 5
•
48
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int8-ov
Text Generation
•
Updated
Nov 5
•
14
OpenVINO/RedPajama-INCITE-7B-Instruct-fp16-ov
Text Generation
•
Updated
Nov 5
•
29
OpenVINO/RedPajama-INCITE-7B-Instruct-int4-ov
Text Generation
•
Updated
Nov 5
•
10
OpenVINO/RedPajama-INCITE-7B-Chat-int4-ov
Text Generation
•
Updated
Nov 5
•
10
OpenVINO/RedPajama-INCITE-7B-Instruct-int8-ov
Text Generation
•
Updated
Nov 5
•
9
OpenVINO/RedPajama-INCITE-7B-Chat-fp16-ov
Text Generation
•
Updated
Nov 5
•
27
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int4-ov
Text Generation
•
Updated
Nov 5
•
11
OpenVINO/RedPajama-INCITE-7B-Chat-int8-ov
Text Generation
•
Updated
Nov 5
•
14
OpenVINO/RedPajama-INCITE-Chat-3B-v1-fp16-ov
Text Generation
•
Updated
Nov 5
•
26
OpenVINO/dolly-v2-7b-int4-ov
Text Generation
•
Updated
Nov 5
•
22
OpenVINO/dolly-v2-7b-int8-ov
Text Generation
•
Updated
Nov 5
•
16
OpenVINO/dolly-v2-7b-fp16-ov
Text Generation
•
Updated
Nov 5
•
21
OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation
•
Updated
Oct 29
•
627
•
1
OpenVINO/dolly-v2-12b-int8-ov
Text Generation
•
Updated
Nov 5
•
12
OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation
•
Updated
Oct 31
•
434
•
1
OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov
Text Generation
•
Updated
Nov 5
•
30
OpenVINO/codegen25-7b-multi-int4-ov
Text Generation
•
Updated
Nov 5
•
21
OpenVINO/persimmon-8b-chat-int4-ov
Text Generation
•
Updated
Nov 5
•
9
OpenVINO/persimmon-8b-chat-int8-ov
Text Generation
•
Updated
Nov 5
•
8
OpenVINO/pythia-1.4b-int4-ov
Text Generation
•
Updated
Nov 5
•
17
OpenVINO/pythia-1.4b-int8-ov
Text Generation
•
Updated
Nov 5
•
10
OpenVINO/persimmon-8b-chat-fp16-ov
Text Generation
•
Updated
Nov 5
•
14
OpenVINO/pythia-1.4b-fp16-ov
Text Generation
•
Updated
Nov 5
•
36
OpenVINO/pythia-12b-int8-ov
Text Generation
•
Updated
Nov 5
•
9
OpenVINO/pythia-2.8b-int8-ov
Text Generation
•
Updated
Nov 5
•
9
OpenVINO/pythia-2.8b-int4-ov
Text Generation
•
Updated
Nov 5
•
21
OpenVINO/pythia-12b-fp16-ov
Text Generation
•
Updated
Nov 5
•
28
OpenVINO/pythia-6.9b-int4-ov
Text Generation
•
Updated
Nov 5
•
9
OpenVINO/pythia-6.9b-int8-ov
Text Generation
•
Updated
Nov 5
•
9
OpenVINO/pythia-2.8b-fp16-ov
Text Generation
•
Updated
Nov 5
•
22
OpenVINO/pythia-6.9b-fp16-ov
Text Generation
•
Updated
Nov 5
•
23
OpenVINO/pythia-1b-int4-ov
Text Generation
•
Updated
Nov 5
•
13
OpenVINO/pythia-1b-int8-ov
Text Generation
•
Updated
Nov 5
•
11
OpenVINO/pythia-1b-fp16-ov
Text Generation
•
Updated
Nov 5
•
26
OpenVINO/neural-chat-7b-v1-1-int4-ov
Text Generation
•
Updated
Nov 5
•
14
OpenVINO/neural-chat-7b-v1-1-int8-ov
Text Generation
•
Updated
Nov 5
•
12
OpenVINO/neural-chat-7b-v1-1-fp16-ov
Text Generation
•
Updated
Nov 5
•
24
OpenVINO/Phi-3-medium-4k-instruct-fp16-ov
Text Generation
•
Updated
Nov 5
•
20
OpenVINO/Phi-3-medium-4k-instruct-int4-ov
Text Generation
•
Updated
Oct 29
•
293
•
3
OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation
•
Updated
Nov 5
•
10
OpenVINO/mpt-7b-int8-ov
Text Generation
•
Updated
Nov 5
•
13
OpenVINO/mpt-7b-fp16-ov
Text Generation
•
Updated
Nov 5
•
18
OpenVINO/starcoder2-15b-int8-ov
Text Generation
•
Updated
Nov 5
•
22
OpenVINO/starcoder2-15b-int4-ov
Text Generation
•
Updated
Nov 5
•
49
OpenVINO/starcoder2-15b-fp16-ov
Text Generation
•
Updated
Nov 5
•
22
OpenVINO/starcoder2-7b-fp16-ov
Text Generation
•
Updated
Nov 5
•
70
OpenVINO/starcoder2-7b-int4-ov
Text Generation
•
Updated
Nov 5
•
48
OpenVINO/starcoder2-7b-int8-ov
Text Generation
•
Updated
Nov 5
•
39
OpenVINO/starcoder2-3b-int4-ov
Text Generation
•
Updated
Nov 5
•
49
OpenVINO/starcoder2-3b-fp16-ov
Text Generation
•
Updated
Nov 5
•
43
OpenVINO/starcoder2-3b-int8-ov
Text Generation
•
Updated
Nov 5
•
47
OpenVINO/Phi-3-mini-4k-instruct-fp16-ov
Text Generation
•
Updated
about 1 month ago
•
319
•
2
OpenVINO/Phi-3-mini-128k-instruct-fp16-ov
Text Generation
•
Updated
Nov 5
•
264
OpenVINO/Phi-3-mini-128k-instruct-int4-ov
Text Generation
•
Updated
Oct 31
•
357
•
2
OpenVINO/Phi-3-mini-4k-instruct-int4-ov
Text Generation
•
Updated
about 1 month ago
•
5.37k
•
1
OpenVINO/Phi-3-mini-4k-instruct-int8-ov
Text Generation
•
Updated
Nov 5
•
23
OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation
•
Updated
Nov 5
•
565
•
2
OpenVINO/open_llama_3b_v2-int4-ov
Text Generation
•
Updated
Nov 5
•
38
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-fp16-ov
Updated
Nov 5
•
13
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int4-ov
Updated
Nov 5
•
9
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int8-ov
Updated
Nov 5
•
5
OpenVINO/gemma-2b-it-fp16-ov
Updated
Nov 20
•
44
OpenVINO/gemma-2b-it-int8-ov
Updated
about 1 month ago
•
15
OpenVINO/gemma-2b-fp16-ov
Updated
Nov 20
•
17
OpenVINO/gemma-2b-int4-ov
Updated
Nov 20
•
30
OpenVINO/gemma-2b-it-int4-ov
Updated
about 1 month ago
•
16
OpenVINO/gemma-7b-fp16-ov
Updated
Nov 5
•
16
OpenVINO/gemma-7b-int4-ov
Updated
Nov 5
•
9
OpenVINO/gemma-7b-int8-ov
Updated
Nov 5
•
105
OpenVINO/gemma-7b-it-int8-ov
Updated
Nov 5
•
11
OpenVINO/gemma-7b-it-fp16-ov
Updated
Nov 5
•
13
OpenVINO/gemma-7b-it-int4-ov
Updated
Nov 5
•
12
OpenVINO/bloomz-1b1-fp16-ov
Updated
Nov 5
•
12
OpenVINO/bloomz-1b1-int4-ov
Updated
Nov 5
•
7
OpenVINO/bloomz-3b-int8-ov
Updated
Nov 5
•
10
OpenVINO/bloomz-1b1-int8-ov
Updated
Nov 5
•
7
OpenVINO/bloomz-3b-int4-ov
Updated
Nov 5
•
6
OpenVINO/bloomz-3b-fp16-ov
Updated
Nov 5
•
14
OpenVINO/codegen-2B-multi-int8-ov
Updated
Nov 5
•
5
OpenVINO/codegen-2B-multi-fp16-ov
Updated
Nov 5
•
11
OpenVINO/codegen-2B-multi-int4-ov
Updated
Nov 5
•
5
OpenVINO/codegen-6B-multi-int4-ov
Updated
Nov 5
•
6
OpenVINO/codegen-6B-multi-fp16-ov
Updated
Nov 5
•
16
OpenVINO/codegen-6B-multi-int8-ov
Updated
Nov 5
•
8
OpenVINO/Phi-3.5-mini-instruct-fp16-ov
Updated
about 1 month ago
•
273
OpenVINO/Phi-3.5-mini-instruct-int8-ov
Updated
about 1 month ago
•
227
OpenVINO/Phi-3.5-mini-instruct-int4-ov
Updated
about 1 month ago
•
68
•
3
OpenVINO/gemma-2-9b-it-int4-ov
Updated
about 1 month ago
•
33
OpenVINO/gemma-2-9b-it-int8-ov
Updated
about 1 month ago
•
52
OpenVINO/gemma-2-9b-it-fp16-ov
Updated
about 1 month ago
•
18
Upvote
18
+14
Share collection
View history
Collection guide
Browse collections