metadata
license: cc-by-4.0
GPTQ quantized falcon-rw-1b
| Branch | Bits | GS | Act Order | Damp % | GPTQ Dataset | Seq Len | Size | ExLlama | Desc |
|---|---|---|---|---|---|---|---|---|---|
| main | 2048 | -- | No | 8-bit, without Act Order and no grouop size. |
license: cc-by-4.0
GPTQ quantized falcon-rw-1b
| Branch | Bits | GS | Act Order | Damp % | GPTQ Dataset | Seq Len | Size | ExLlama | Desc |
|---|---|---|---|---|---|---|---|---|---|
| main | 2048 | -- | No | 8-bit, without Act Order and no grouop size. |