nm-testing/pixtral-12b-w4a16-actorder-group
Updated
•
10
Edit Models filters
Active filters:
compressed-tensors
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM
Updated
•
8
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM
Updated
•
6
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM
Updated
•
5
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM
Updated
•
6
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM
Updated
•
6
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM
Updated
•
6
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM
Updated
•
6
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM
Updated
•
8
otherhalf-dev/Qwen2.5-14B-Instruct-abliterated-v2-INT8
Updated
•
2
BigHuggyD/EVA-UNIT-01_EVA-LLaMA-3.33-70B-v0.1-FP8-Dynamic
Text Generation
•
Updated
•
56
neuralmagic-ent/Qwen2.5-0.5B-quantized.w4a16
Text Generation
•
Updated
•
5
neuralmagic-ent/Qwen2.5-1.5B-quantized.w4a16
Text Generation
•
Updated
•
3
neuralmagic-ent/Qwen2.5-3B-quantized.w4a16
Text Generation
•
Updated
•
2
ayakzobav/gemma2-27b-it-static-fp8
Updated
•
18
nm-testing/gemma-2-9b-it-FP8-dynamic-KV
Updated
•
3
BigHuggyD/MarsupialAI_Dumbstral-169B-FP8-Dynamic
Text Generation
•
Updated
•
203
winglian/Llama-3.3-70B-Instruct-FP8-Dynamic
Text Generation
•
Updated
•
20
nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-Uncompressed
Updated
•
3
nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-BitMask
Updated
•
5
horheynm/Phi-3-mini-4k-instruct-kv_cache
Updated
•
19
anhbn/Phi-3.5-mini-instruct-W8A8-Dynamic-Per-Token
Updated
•
26