Iwan Kawrakow's picture

13

Iwan Kawrakow

ikawrakow

·

AI & ML interests

None yet

Organizations

None yet

ikawrakow's activity

New activity in ikawrakow/validation-datasets-for-llama.cpp 4 months ago

Error with test data

#2 opened 4 months ago by

New activity in ikawrakow/various-2bit-sota-gguf 10 months ago

What 2bit quantization approach are you using?

#13 opened 10 months ago by

New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 11 months ago

Dataset for importance matrix?

#3 opened 11 months ago by

New activity in ikawrakow/mixtral-8x7b-quantized-gguf 11 months ago

Broken M quants

#2 opened 11 months ago by

New activity in ikawrakow/various-2bit-sota-gguf 11 months ago

What -ctx and -chunks parameters did you use to make the iMatrix of the Lllama 2 70b?

#9 opened 11 months ago by

Would love a deepseekcode 2bit quant. I bet others would love it too :)

#6 opened 11 months ago by

[Model request] Saily 100b, Saily 220b

#5 opened 11 months ago by

New activity in ikawrakow/various-2bit-sota-gguf 12 months ago

Could We combine AWQ and Importance Matrix calculation together to further improve perplexity.

#4 opened 12 months ago by

New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 12 months ago

mixtral-instruct-8x7b-q3k-medium.gguf

#2 opened 12 months ago by

New activity in ikawrakow/open-hermes-2.5-mistral-7b-quantized-gguf 12 months ago

SOTA 2-Quant of Nous-Heremes-Solar-10.7B and Nous-Hermes-2-Yi-34B, Please 🙏

#1 opened 12 months ago by

New activity in ikawrakow/various-2bit-sota-gguf 12 months ago

Please 3b model rocket 2bit?

#1 opened 12 months ago by

New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 12 months ago

Q5_1 & Q5_K_M quant

#1 opened 12 months ago by

New activity in ikawrakow/mixtral-8x7b-quantized-gguf 12 months ago

Mixtral Instruct quant

#1 opened 12 months ago by

Mixtral Instruct quant

#1 opened 12 months ago by

New activity in ikawrakow/various-2bit-sota-gguf 12 months ago

Please 3b model rocket 2bit?

#1 opened 12 months ago by

Please 3b model rocket 2bit?

#1 opened 12 months ago by