nm-testing/Meta-Llama-3-8B-Instruct-FP8-Dynamic-IA-Per-Tensor-Weight-testing
Updated
•
27
Edit Models filters
Active filters:
compressed-tensors
CalamitousFelicitousness/Llama-3.3-70B-Instruct-W8A8-INT8
Updated
•
337
•
3
yejingfu/q-Llama-3.3-70B-Instruct-888
Updated
•
17.6k
cortecs/Llama-3_1-Nemotron-51B-Instruct-FP8-Dynamic
Text Generation
•
Updated
•
78
nm-testing/TinyLlama-1.1B-Chat-v1.0-2of4-Sparse-Dense-Compressor
Updated
•
40
nm-testing/TinyLlama-1.1B-Chat-v1.0-INT8-Dynamic-IA-Per-Channel-Weight-testing
Updated
•
24
nm-testing/TinyLlama-1.1B-Chat-v1.0-INT8-Dynamic-IA-Per-Tensor-Weight-testing
Updated
•
24
nm-testing/TinyLlama-1.1B-Chat-v1.0-INT8-Static-testing
Updated
•
24
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-W8A8-testing
Updated
•
12
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-channel_weights_per_token_dynamic_act_fp8-BitMaskCompressed
Updated
•
2
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_weights_per_token_dynamic_act_fp8-BitMaskCompressed
Updated
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-channel_weights_tensor_act_fp8-BitMaskCompressed
Updated
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_weights_tensor_act_fp8-BitMaskCompressed
Updated
Infermatic/Llama-3.3-70B-Instruct-FP8-Dynamic
Text Generation
•
Updated
•
2.06k
Infermatic/L3.3-70B-Euryale-v2.3-FP8-Dynamic
Text Generation
•
Updated
•
923
BigHuggyD/Sao10K_L3.3-70B-Euryale-v2.3-FP8-Dynamic
Text Generation
•
Updated
•
348
horheynm/TinyLlama-1.1B-Chat-v1.0-W4A16-G128
Updated
•
2
nm-testing/llama2.c-stories15M-pruned_50.2of4-uncompressed-tensor_weights_tensor_act_fp8-BitMaskCompressed
Updated
•
1
horheynm/d
Updated
•
2
horheynm/llama2.c_stories15M_pruned_50.2of4_compressed
Updated
•
3
horheynm/llama2.c_stories15M_pruned_50.2of4_uncompressed
Updated
•
2
BigHuggyD/EVA-UNIT-01_EVA-LLaMA-3.33-70B-v0.0-FP8-Dynamic
Text Generation
•
Updated
•
22
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Static-Per-Tensor-Sym
Updated
•
685
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dynamic-Asym
Updated
•
679
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Static-Per-Tensor-Asym
Updated
•
712
nm-testing/llama2.c-stories15M-pruned_50.0-2of4-BitMaskCompressed
Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.0-2of4-BitMaskCompressed
Updated
•
4
nm-testing/Llama-3.2-1B-Instruct-W8A8-Static-Per-Tensor-Asym
Updated
•
21
horheynm/TinyLlama_1.1B_Chat_v1.0_FP8_Dynamic_compressed
Updated
•
138
horheynm/TinyLlama_1.1B_Chat_v1.0_FP8_Dynamic_uncompressed
Updated
•
57