EXL2 quants of Phi-3 mini 128k instruct
2.50 bits per weight (broken)3.00 bits per weight4.00 bits per weight5.00 bits per weight6.00 bits per weight
measurement.json
-