-
-
-
-
-
-
Inference status
Active filters:
fp8
amd/Llama-3.2-11B-Vision-Instruct-FP8-KV
amd/Llama-3.2-3B-Instruct-FP8-KV
amd/Llama-3.2-3B-FP8-KV
amd/Llama-3.2-1B-Instruct-FP8-KV
amd/Llama-3.2-1B-FP8-KV
SicariusSicariiStuff/Dusk_Rainbow_FP8
amd/Llama-3.2-90B-Vision-Instruct-FP8-KV
soprasteria/Mixtral-8x7B-Instruct-v0.1-FP8
Updated
•
17
neuralmagic/Phi-3.5-mini-instruct-FP8-KV
Text Generation
•
Updated
•
173
•
2
CalamitousFelicitousness/SorcererLM-8x22b-FP8-Dynamic
obamaTeo/llama-finetune-8bit-wiki-284-ver2
Updated
fxmarty/quark-legacy-fp8
Updated
•
99
amd/jais-13b-chat-FP8
neuralmagic/pixtral-12b-FP8-dynamic
Text Generation
•
Updated
•
2.88k
•
7
predibase/Qwen2.5-14B-FP8
CalamitousFelicitousness/banana-2-b-72b-FP8-Dynamic
Updated
taozi555/Llama-Guard-3-8B-FP8
ajinkya-tejankar/Mistral-7B-Instruct-v0.2-FP8-UltraChat-2000-KV
Updated
Infermatic/Lumimaid-v0.2-70B-FP8-Dynamic
Updated
•
16
predibase/Qwen2.5-32B-Instruct-FP8
Updated
•
257
Infermatic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-Dynamic
Text Generation
•
Updated
•
193
predibase/Mistral-7B-Instruct-v0.2-FP8-UltraChat-2000-KV
Updated
neuralmagic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic
Text Generation
•
Updated
•
50.9k
•
14
Infermatic/magnum-v4-72b-FP8-Dynamic
Text Generation
•
Updated
•
971
•
1
amd/dbrx-base-FP8-KV
Infermatic/Stellar-Odyssey-12b-v0.0-FP8-Dynamic
Updated
Infermatic/Chronos-Platinum-72B-FP8-Dynamic
Infermatic/Nautilus-70B-v0.1-FP8-Dynamic
Updated
yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8
Text Generation
•
Updated
•
24.1k
mysticbeing/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-DYNAMIC
Text Generation
•
Updated
•
109
•
3