(Solved) "Some parameters are on the meta device device because they were offloaded to the cpu."
#9 opened 5 months ago
by
cptjtejur
Help : Unexpected LLM response (in random text)
1
#8 opened 5 months ago
by
Cheangys
Alternative quantizatioons.
1
#7 opened 5 months ago
by
ZeroWw
What about suzume?
#6 opened 6 months ago
by
BahamutRU
Here is a 4 bit GPTQ quantized version
#5 opened 6 months ago
by
chplushsieh
Can we use orthogonalization to make the LLaMa-3 (8B-70B) More Intelligent?
#4 opened 6 months ago
by
Joseph717171
exl2 quants
#3 opened 6 months ago
by
Apel-sin