llmixer
/

BigWeave-v20-110b-4.0bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

BigWeave-v20-110b-4.0bpw-h6-exl2 / README.md

llmixer's picture

Create README.md

4590f47 verified 9 months ago

|

history blame contribute delete

225 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 4.0bpw
  - h6
  - exl2

Exllamav2 4.0bpw h6 quant for BigWeave-v20-110b.

Default calibration dataset.