EXL2 quants of c4ai-command-r-plus
2.50 bits per weight (still converting)
3.00 bits per weight (still converting)
3.50 bits per weight (still converting)
4.00 bits per weight
4.50 bits per weight (still converting)
5.00 bits per weight (still converting)
6.00 bits per weight (still converting)