Models

BSC-LT/salamandra-2b-base-fp8

Text Generation • 2B • Updated Mar 26 • 9

BSC-LT/salamandra-7b-base-fp8

Text Generation • 8B • Updated Mar 26 • 6 • 1

BSC-LT/salamandra-2b-instruct-fp8

Text Generation • 2B • Updated Mar 26 • 11

yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • 8B • Updated Oct 31, 2024 • 970

CalamitousFelicitousness/EVA-Qwen2.5-32B-v0.1-FP8-Dynamic

Text Generation • 33B • Updated Oct 31, 2024 • 4

PyrTools/Rocinante-12B-v1.1-FP8-Dynamic

12B • Updated Oct 31, 2024 • 3

PyrTools/Cydonia-22B-v1.2-FP8-Dynamic

22B • Updated Nov 1, 2024 • 3

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16

Text Generation • 11B • Updated Nov 5, 2024 • 5

nm-testing/pixtral-12b-FP8-dynamic-all

13B • Updated Feb 7 • 3

SicariusSicariiStuff/TheDrummer_Behemoth-123B-v1.1_FP8

123B • Updated Nov 1, 2024 • 3

nm-testing/Llama-3.2-1B-Instruct-FP8-KV

1B • Updated Nov 1, 2024 • 7.82k

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16

Text Generation • 2B • Updated Nov 5, 2024 • 3

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A8

Text Generation • 8B • Updated Nov 5, 2024 • 3

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A16

Text Generation • 3B • Updated Nov 5, 2024 • 3

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W4A16

Text Generation • 11B • Updated Nov 5, 2024 • 3

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W4A16

Text Generation • 2B • Updated Nov 5, 2024 • 3

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A8

Text Generation • 8B • Updated Nov 5, 2024 • 3

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A16

Text Generation • 3B • Updated Nov 5, 2024 • 3

Vikhrmodels/vikhr-nemo-12b-W8A8-gptq-jsoncal

Text Generation • 12B • Updated Nov 4, 2024 • 12

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W8A8

Text Generation • 71B • Updated Nov 5, 2024 • 2

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W8A16

Text Generation • 19B • Updated Nov 5, 2024 • 4

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W8A8

Text Generation • 71B • Updated Nov 5, 2024 • 2

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W8A16

Text Generation • 19B • Updated Nov 5, 2024 • 2

leon-se/Molmo-7B-D-0924-FP8-Dynamic

8B • Updated Nov 4, 2024 • 3

yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • 71B • Updated Nov 5, 2024 • 2

gmonair/Qwen2.5-Math-72B-Instruct-W4A16-padded

12B • Updated Nov 5, 2024 • 2

gmonair/Qwen2.5-Math-72B-Instruct-W8A16-padded

20B • Updated Nov 5, 2024 • 2

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16-KV8

2B • Updated Nov 5, 2024 • 2

stan-hua/Llama-3.1-8B-Instruct-LC-RTN-W4A16-KV4

2B • Updated Nov 5, 2024 • 2

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16-KV4

11B • Updated Nov 5, 2024 • 2