Hugging Face's logo

Lewdiculous
/
SOVL_Llama3_8B-GGUF-IQ-Imatrix

GGUF
Inference Endpoints
imatrix
Model card Files Community
4
Lewdiculous commited on
Commit
c40f9c4
•
1 Parent(s): a5aa173

Updated! New quants!

Browse files
Files changed (13) hide show
  1. SOVL_Llama3_8B-F16.gguf +3 -0
  2. SOVL_Llama3_8B-IQ3_M-imat.gguf +3 -0
  3. SOVL_Llama3_8B-IQ3_XXS-imat.gguf +3 -0
  4. SOVL_Llama3_8B-IQ4_NL-imat.gguf +3 -0
  5. SOVL_Llama3_8B-IQ4_XS-imat.gguf +3 -0
  6. SOVL_Llama3_8B-Q4_K_M-imat.gguf +3 -0
  7. SOVL_Llama3_8B-Q4_K_S-imat.gguf +3 -0
  8. SOVL_Llama3_8B-Q5_K_M-imat.gguf +3 -0
  9. SOVL_Llama3_8B-Q5_K_S-imat.gguf +3 -0
  10. SOVL_Llama3_8B-Q6_K-imat.gguf +3 -0
  11. SOVL_Llama3_8B-Q8_0-imat.gguf +3 -0
  12. imatrix-with-rp-ex.txt +0 -0
  13. imatrix.dat +3 -0
SOVL_Llama3_8B-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0823dcff38e60b4ccf0f402a44c7f7bf722a27c4527eb604f01fbe55b2663321
3
+ size 16068890432
SOVL_Llama3_8B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6497780a0c4dbc15994573fd8668a862fcbb745fcda2bebc34bcbc52adba4099
3
+ size 3784822912
SOVL_Llama3_8B-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19d4a78ed632cdab1195b8ad92ab030b865e4c5e97cf935f97ecc90a33fc6395
3
+ size 3274911872
SOVL_Llama3_8B-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5e730977600f8b3705f04a3333296da48451788aa0917b51f0cad1cf4e6f89b
3
+ size 4677988480
SOVL_Llama3_8B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:694f25e4b073e14487d9c86e7f4d5160c8f1b64a3a9339ed62a87dd4e3028b81
3
+ size 4447662208
SOVL_Llama3_8B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85d6aefc8a0d713966b3b4da4810f0485a74aea30d61be6dfe0a806da81be0c6
3
+ size 4920733824
SOVL_Llama3_8B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc42e2be1226e016ab9748d4d7dedab75932af65f8abc9da087ed6bbefac0453
3
+ size 4692668544
SOVL_Llama3_8B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5fd4f629682d39a11c016204e21350a6ca90a159bbc4853048ebe890f0fa60a
3
+ size 5732987008
SOVL_Llama3_8B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0545f6306c0b153405a6dc27772ba755b8cfe1eb07232da65428ff47889c780
3
+ size 5599293568
SOVL_Llama3_8B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75f3169822682c7787e3b5e7f7dc04344725776a24d6bd2cb43987811ba8c43d
3
+ size 6596006016
SOVL_Llama3_8B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:febc410d23dffa672e5770e9270f8fcb96cb347f9c65bd7265d265225a576139
3
+ size 8540770432
imatrix-with-rp-ex.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7931129e0948e8c21cb5ea06d1ec8b1f06e52cdf01ff6b66360038dd9f51d88d
3
+ size 4988187