grimulkan
/

lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2

Text Generation

Inference Endpoints

Model card Files Files and versions Community

lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2 / README.md

grimulkan's picture

Update README.md

69657e9 verified 11 months ago

|

167 Bytes

metadata

license: cc-by-2.0

This is an EXL2 6-bit quantization of lzlv-longLORA-70b-rope8-32k-fp16