imatrix quant request
First of all, thank you so much for your work! 🤗
Could you please to imatrix quants for my following models:
SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha
SicariusSicariiStuff/Tenebra_30B_Alpha01_FP16
SicariusSicariiStuff/Tinybra_13B
Many thanks!
Sure can try :) But next time, please provide URLs.
Shoulöd be done in a few hours, too.
bartowski already made the quants for my LLAMA-3_8B_Unaligned_Alpha, so these are not needed.
Only the Tenebra ones please 🤗
many thanks!
Well, too late, too much automation :) Anyway, have fun!
Hello, I humbly request iMatrix quant for my new model:
https://huggingface.co/SicariusSicariiStuff/2B_or_not_2B
Many thanks!
At the very least the name is interesting °v°. Queued!
Hello, I humbly request iMatrix quant for my new model:
https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow
Many thanks!
unfortunately, i have run into quite a few operational issues (unrelated to the model), so quantising it is quite slow at the moment, and therefore, it will be delayed. or rather, quantising will probably be okayish, but it's stuck at the conversion step at the moment.
NP, you can cancel the request, bartowski already quantized and uploaded GGUFs.
Thanks anyway though 🤗
great to hear it worked out :)
Hello,
I humbly request iMatrix quant for my new model:
https://huggingface.co/SicariusSicariiStuff/Phi-3.5-mini-instruct_Uncensored
Many thanks!
Queued!