Menlo Research Quantizations
Ben Shankles PRO
warshanks
AI & ML interests
MLX, AWQ, GPTQ
Recent Activity
updated
a collection
about 19 hours ago
AWQ Quants
updated
a collection
about 19 hours ago
AWQ Quants
upvoted
a
changelog
about 24 hours ago
Introducing a better Hugging Face CLI
Organizations
W4A16 quants made with llmcompressor
-
warshanks/Qwen3-8B-abliterated-AWQ
Text Generation • 2B • Updated • 20 -
warshanks/Qwen3-4B-abliterated-AWQ
Text Generation • 1B • Updated • 56 -
warshanks/Qwen3-1.7B-abliterated-AWQ
Text Generation • 0.8B • Updated • 18 -
warshanks/Josiefied-Qwen3-4B-abliterated-v2-AWQ
Text Generation • 1B • Updated • 36
Menlo Research Quantizations
W4A16 quants made with llmcompressor
-
warshanks/Qwen3-8B-abliterated-AWQ
Text Generation • 2B • Updated • 20 -
warshanks/Qwen3-4B-abliterated-AWQ
Text Generation • 1B • Updated • 56 -
warshanks/Qwen3-1.7B-abliterated-AWQ
Text Generation • 0.8B • Updated • 18 -
warshanks/Josiefied-Qwen3-4B-abliterated-v2-AWQ
Text Generation • 1B • Updated • 36
spaces
7
pinned
Running
on
Zero
1
MedGemma 27B IT
🩻
Chat with MedGemma 27B, a medical variant of Gemma 3
pinned
Running
on
Zero
22
MedGemma 4B IT
🩻
Chat with MedGemma 4B, a medical variant of Gemma 3
pinned
Running
on
Zero
8
Lingshu 7B
🩻
Chat with Lingshu 7B, a multimodal medical model
pinned
Running
on
Zero
3
Lingshu 32B
🩻
Chat with Lingshu 32B, a multimodal medical model
Running
on
Zero
FLUX.1 [dev]
🖥
Generate images from text prompts
Sleeping
Seinfeld
☕
Chat with Seinfeld powered by Gemini
models
12
warshanks/Qwen3-8B-abliterated-AWQ
Text Generation
•
2B
•
Updated
•
20
warshanks/Qwen3-1.7B-abliterated-AWQ
Text Generation
•
0.8B
•
Updated
•
18
warshanks/Lucy-AWQ
Text Generation
•
0.8B
•
Updated
•
18
warshanks/Lucy-128k-AWQ
Text Generation
•
0.8B
•
Updated
•
81
warshanks/Dolphin-Mistral-24B-Venice-Edition-AWQ
4B
•
Updated
•
24
warshanks/Voxtral-Mini-3B-2507-FP8
Audio-Text-to-Text
•
Updated
•
19
warshanks/Jan-nano-128k-AWQ
Text Generation
•
1B
•
Updated
•
54
warshanks/Jan-nano-AWQ
Text Generation
•
1B
•
Updated
•
50
•
2
warshanks/Qwen3-4B-abliterated-AWQ
Text Generation
•
1B
•
Updated
•
56
warshanks/Ministral-8B-Instruct-2410-AWQ
2B
•
Updated
•
26
datasets
0
None public yet