DevQuasar/ibm-granite.granite-3.0-8b-lora-intrinsics-v0.1-GGUF
Text Generation
•
Updated
•
45
DevQuasar
community
Verified
AI & ML interests
Open-Source LLMs, Local AI Projects: https://pypi.org/project/llm-predictive-router/
Recent Activity
View all activity
DevQuasar's activity
csabakecskemeti
updated
a
model
about 13 hours ago
csabakecskemeti
updated
2
collections
about 15 hours ago
csabakecskemeti
updated
2
models
1 day ago
csabakecskemeti
updated
2
models
1 day ago
csabakecskemeti
updated
2
collections
2 days ago
csabakecskemeti
updated
a
model
2 days ago
csabakecskemeti
updated
2
collections
2 days ago
csabakecskemeti
updated
5
models
2 days ago
DevQuasar/HuggingFaceTB.finemath-ablation-4plus-160B-GGUF
Text Generation
•
Updated
•
126
DevQuasar/HuggingFaceTB.finemath-ablation-3plus-160B-GGUF
Text Generation
•
Updated
•
124
DevQuasar/HuggingFaceTB.finemath-ablation-infiwebmath-3plus-GGUF
Text Generation
•
Updated
•
131
DevQuasar/HuggingFaceTB.finemath-ablation-fwedu-GGUF
Text Generation
•
Updated
•
126
DevQuasar/HuggingFaceTB.finemath-ablation-finemath-infimath-3plus-GGUF
Text Generation
•
Updated
•
127
csabakecskemeti
posted
an
update
7 days ago
Post
1187
tiiuae Falcon3 10B Q8 playground:
DevQuasar/Mi50
Also find my tiiuae Falcon3 Quant collection here:
https://huggingface.co/collections/DevQuasar/tiiuae-falcon3-676236626f3c57d1a19c6c1d
Enjoy!
DevQuasar/Mi50
Also find my tiiuae Falcon3 Quant collection here:
https://huggingface.co/collections/DevQuasar/tiiuae-falcon3-676236626f3c57d1a19c6c1d
Enjoy!
csabakecskemeti
posted
an
update
10 days ago
Post
4460
The AMD Instinct MI50 (~$110) is surprisingly fast for inference Quantized models.
This runs a Llama 3.1 8B Q8 with Llama.cpp
DevQuasar/Mi50
A little blogpost about the HW
http://devquasar.com/uncategorized/amd-radeon-instinct-mi50-cheap-inference/
This runs a Llama 3.1 8B Q8 with Llama.cpp
DevQuasar/Mi50
A little blogpost about the HW
http://devquasar.com/uncategorized/amd-radeon-instinct-mi50-cheap-inference/