FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM!
•
44 items
•
Updated
•
68
Mehdi CHTAYTI
systemicAnomaly
AI & ML interests
None yet
Recent Activity
updated
a model
3 days ago
soprasteria/Mistral-Small-3.1-24B-Instruct-2503-FP8-KV
published
a model
6 days ago
soprasteria/Mistral-Small-3.1-24B-Instruct-2503-FP8-KV
liked
a model
7 days ago
mistralai/Mistral-Small-3.1-24B-Instruct-2503
Organizations
