llmixer
/

Midnight-Rose-103B-v2.0.3-2.4bpw-h6-exl2

Create README.md

1532cbd verified 7 months ago

No virus

249 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 2.4bpw
  - h6
  - exl2

Exllamav2 2.4bpw h6 quant for Midnight-Rose-103B-v2.0.3.

Default calibration dataset.