How I select models ? First, I bench them, to trim the overfit & dumbified models. Then, I test them. The smartest to my taste end-up here.
Nexes the Old
Nexesenex
AI & ML interests
Playing with the latest features of KoboldCPP and quants of LlamaCPP.
Sharing my favorite models quants with everyone.
Organizations
Collections
2
models
55
Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF
Updated
•
508
•
67
Nexesenex/mlabonne_Beyonder-4x7B-v3_iMat_Custom_Quant_Stategies-GGUF
Updated
Nexesenex/NousResearch_Llama-2-7b-hf_iMat_Custom_Quant_Stategies-GGUF
Updated
Nexesenex/princeton-nlp_Sheared-LLaMA-2.7B_iMat_Custom_Quant_Stategies-GGUF
Updated
Nexesenex/Google_Gemma-2-9b-it_iMat_Custom_Quant_Stategies-GGUF
Updated
•
608
Nexesenex/Meta_Llama-3.1-8b-it_iMat_Custom_Quant_Stategies-GGUF
Updated
•
165
•
2
Nexesenex/llama-3-70B-Instruct-abliterated-CQ-GGUF
Updated
•
23
•
1
Nexesenex/L3-70B-daybreak-abliterated-v0.4-GGUF-BF16
Updated
•
37
Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF
Updated
•
127
•
10
Nexesenex/LaDameBlanche-v2-95b-iMat-CQ.GGUF
Updated
•
1
•
1
datasets
None public yet