imatrix quant request

#114
by SicariusSicariiStuff - opened

First of all, thank you so much for your work! 🤗
Could you please to imatrix quants for my following models:

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha
SicariusSicariiStuff/Tenebra_30B_Alpha01_FP16
SicariusSicariiStuff/Tinybra_13B

Many thanks!

Sure can try :) But next time, please provide URLs.

mradermacher changed discussion status to closed

Shoulöd be done in a few hours, too.

bartowski already made the quants for my LLAMA-3_8B_Unaligned_Alpha, so these are not needed.
Only the Tenebra ones please 🤗

Well, too late, too much automation :) Anyway, have fun!

Hello, I humbly request iMatrix quant for my new model:

https://huggingface.co/SicariusSicariiStuff/2B_or_not_2B

Many thanks!

At the very least the name is interesting °v°. Queued!

Hello, I humbly request iMatrix quant for my new model:

https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow

Many thanks!

Queued. You can follow it's progress at http://hf.tst.eu/status.html Good luck to your model :)

unfortunately, i have run into quite a few operational issues (unrelated to the model), so quantising it is quite slow at the moment, and therefore, it will be delayed. or rather, quantising will probably be okayish, but it's stuck at the conversion step at the moment.

NP, you can cancel the request, bartowski already quantized and uploaded GGUFs.
Thanks anyway though 🤗

great to hear it worked out :)

Hello,

I humbly request iMatrix quant for my new model:

https://huggingface.co/SicariusSicariiStuff/Phi-3.5-mini-instruct_Uncensored

Many thanks!

Queued!

Sign up or log in to comment