mlabonne

/

Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

like 120

I can get Q4KM working via LM Studio no problem but for some reason this variant doesn't work in Jan v0.5.2 (first model I've used that has had a load failure). I'm a newbie so with that in mind, any thoughts or ideas I can try or should I just use one of the ZeroWw variants? Thanks in advance.