RedHatAI/Qwen2-1.5B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
25
RedHatAI/Qwen2-0.5B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
26
RedHatAI/Qwen2-72B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
1.25k
•
1
RedHatAI/Qwen2-7B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
32
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
56
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
27
RedHatAI/Llama-2-7b-chat-quantized.w4a16
Text Generation
•
Updated
•
39
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
192
•
2
RedHatAI/Llama-2-7b-chat-quantized.w8a16
Text Generation
•
Updated
•
139
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a16
Text Generation
•
Updated
•
253
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
1.64k
•
4
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
2.11k
•
3
RedHatAI/SparseLLama-2-7b-ultrachat_200k-pruned_50.2of4
Text Generation
•
Updated
•
40
RedHatAI/SparseLlama-2-7b-evolcodealpaca-pruned_50.2of4
Text Generation
•
Updated
•
17
RedHatAI/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation
•
Updated
•
74
•
2
RedHatAI/Llama-2-7b-gsm8k-pruned_70
Text Generation
•
Updated
•
16
RedHatAI/Llama-2-7b-gsm8k-pruned_50
Text Generation
•
Updated
•
51
•
1
RedHatAI/Llama-2-7b-gsm8k
Text Generation
•
Updated
•
1.92k
•
3
RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV
Text Generation
•
Updated
•
5.32k
•
8
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
Updated
•
9.32k
•
18
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_50.2of4
Text Generation
•
Updated
•
15
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_70
Updated
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
16
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
57
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
21
•
1
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
24
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70
Text Generation
•
Updated
•
16
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50
Text Generation
•
Updated
•
15
RedHatAI/Llama-2-7b-cnn-daily-mail
Text Generation
•
Updated
•
17
RedHatAI/Llama-2-7b-ultrachat200k-pruned_70
Text Generation
•
Updated
•
21