Hugging Face's logo

Lewdiculous
/
kukulemon-7B-GGUF-IQ-Imatrix

Transformers
GGUF
English
quantized
roleplay
imatrix
mistral
Merge
Model card Files Community
Lewdiculous commited on
Commit
03c8243
•
1 Parent(s): bc0ad12

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. kukulemon-7B-Q5_K_M-imat.gguf +3 -0
  3. kukulemon-7B-Q5_K_S-imat.gguf +3 -0
  4. kukulemon-7B-Q6_K-imat.gguf +3 -0
  5. kukulemon-7B-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  kukulemon-7B-F16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  kukulemon-7B-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ kukulemon-7B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ kukulemon-7B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ kukulemon-7B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ kukulemon-7B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
kukulemon-7B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b3efd45c9ea632a0836758b28776aa53fc645903f8ec64371046c12cd803896
3
+ size 5131409120
kukulemon-7B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fc3b5db6c6fe1ef143c759b7a40aca9defa27ec46710f8a4a3bd7842f6ce54e
3
+ size 4997715680
kukulemon-7B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2881f7930911017adecdfe93224e79673e81b80dce2c15bd26d73c8ee24bbbd
3
+ size 5942064864
kukulemon-7B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01a2d5dfe865ebcb76a047f23b8d74270eebb4048de27ec4e52b5932b8604779
3
+ size 7695857376