Lyra4-Gutenberg2-12B EXL2
Collection
3 items
•
Updated
Lyra4-Gutenberg2-12B-5bpw-h6-exl2
This is a 5bpw h6 exl2 quant of Lyra4-Gutenberg2-12B
Built-in(default) calibration dataset is used.
- Downloads last month
- 5
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.