RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
71.9k
•
7
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
1.65k
•
12
RedHatAI/Llama-3.2-3B-quantized.w8a8
Updated
•
100
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
26
•
1
RedHatAI/SmolLM-135M-Instruct-quantized.w8a8
Text Generation
•
Updated
•
38
•
1
RedHatAI/SmolLM-360M-Instruct-quantized.w8a8
Text Generation
•
Updated
•
40
RedHatAI/SmolLM-135M-Instruct-quantized.w8a16
Text Generation
•
Updated
•
86
RedHatAI/gemma-2-27b-it-quantized.w8a16
Text Generation
•
Updated
•
56
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
39
•
2
RedHatAI/gemma-2-2b-it-quantized.w8a8
Text Generation
•
Updated
•
50
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation
•
Updated
•
146
•
4
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
1.62k
RedHatAI/gemma-2-2b-it-quantized.w4a16
Text Generation
•
Updated
•
1.91k
•
1
RedHatAI/gemma-2-9b-it-quantized.w4a16
Text Generation
•
Updated
•
1.62k
•
2
RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16
Text Generation
•
Updated
•
42
RedHatAI/gemma-2-2b-quantized.w8a16
Text Generation
•
Updated
•
49
RedHatAI/gemma-2-2b-it-quantized.w8a16
Text Generation
•
Updated
•
34
•
1
RedHatAI/gemma-2-9b-it-quantized.w8a16
Text Generation
•
Updated
•
1.76k
•
1
RedHatAI/gemma-2-2b-it-FP8
Updated
•
1.76k
•
1
RedHatAI/starcoder2-15b-quantized.w8a8
Text Generation
•
Updated
•
27
RedHatAI/starcoder2-7b-quantized.w8a8
Text Generation
•
Updated
•
54
RedHatAI/starcoder2-3b-quantized.w8a8
Text Generation
•
Updated
•
65
RedHatAI/starcoder2-7b-quantized.w8a16
Text Generation
•
Updated
•
31
RedHatAI/starcoder2-3b-quantized.w8a16
Text Generation
•
Updated
•
29
RedHatAI/starcoder2-15b-quantized.w8a16
Text Generation
•
Updated
•
26
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation
•
Updated
•
35
RedHatAI/Meta-Llama-3.1-405B-FP8
Text Generation
•
Updated
•
20
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation
•
Updated
•
24
RedHatAI/starcoder2-3b-FP8
Text Generation
•
Updated
•
77
RedHatAI/starcoder2-7b-FP8
Text Generation
•
Updated
•
57