Csaba Kecskemeti PRO

csabakecskemeti

None yet

updated a collection 2 minutes ago

updated a collection 2 minutes ago

new activity 3 minutes ago

Post

1184

tiiuae Falcon3 10B Q8 playground:
DevQuasar/Mi50

Also find my tiiuae Falcon3 Quant collection here:
https://huggingface.co/collections/DevQuasar/tiiuae-falcon3-676236626f3c57d1a19c6c1d

Enjoy!

Post

4459

The AMD Instinct MI50 (~$110) is surprisingly fast for inference Quantized models.

This runs a Llama 3.1 8B Q8 with Llama.cpp
DevQuasar/Mi50

A little blogpost about the HW
http://devquasar.com/uncategorized/amd-radeon-instinct-mi50-cheap-inference/

None public yet