EXL2 quants of TinyLlama-1.1B-32k (1.1B).
2.50 bits per weight2.70 bits per weight3.00 bits per weight3.50 bits per weight4.00 bits per weight4.65 bits per weight5.00 bits per weight6.00 bits per weight7.00 bits per weight8.00 bits per weight
measurement.json
