Hugging Face's logo

Lewdiculous
/
rogue-enchantress-32k-7B-GGUF-IQ-Imatrix

GGUF
roleplay
mistral
Inference Endpoints
imatrix
conversational
Model card Files Community
Lewdiculous commited on
Commit
3487c53
•
1 Parent(s): 829e832

Add quants.

Browse files
Files changed (14) hide show
  1. .gitattributes +12 -0
  2. imatrix-with-rp-ex.txt +0 -0
  3. imatrix.dat +3 -0
  4. rogue-enchantress-32k-7B-IQ3_M-imat.gguf +3 -0
  5. rogue-enchantress-32k-7B-IQ3_S-imat.gguf +3 -0
  6. rogue-enchantress-32k-7B-IQ3_XXS-imat.gguf +3 -0
  7. rogue-enchantress-32k-7B-IQ4_NL-imat.gguf +3 -0
  8. rogue-enchantress-32k-7B-IQ4_XS-imat.gguf +3 -0
  9. rogue-enchantress-32k-7B-Q4_K_M-imat.gguf +3 -0
  10. rogue-enchantress-32k-7B-Q4_K_S-imat.gguf +3 -0
  11. rogue-enchantress-32k-7B-Q5_K_M-imat.gguf +3 -0
  12. rogue-enchantress-32k-7B-Q5_K_S-imat.gguf +3 -0
  13. rogue-enchantress-32k-7B-Q6_K-imat.gguf +3 -0
  14. rogue-enchantress-32k-7B-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ rogue-enchantress-32k-7B-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ rogue-enchantress-32k-7B-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ rogue-enchantress-32k-7B-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ rogue-enchantress-32k-7B-IQ4_NL-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ rogue-enchantress-32k-7B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ rogue-enchantress-32k-7B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ rogue-enchantress-32k-7B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ rogue-enchantress-32k-7B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ rogue-enchantress-32k-7B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ rogue-enchantress-32k-7B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
47
+ rogue-enchantress-32k-7B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
imatrix-with-rp-ex.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7a49b6e44755cb47b22369a005d012b84a7f3221fbb083acbb5a1c633a84e7c
3
+ size 4988193
rogue-enchantress-32k-7B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:265e42537fde82413d664ecc6afa0037d57d1070e22b67882298165ce5a27258
3
+ size 3284892256
rogue-enchantress-32k-7B-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bc3a792323bbe9cd6e9bbc50ed952ab349ff5b27fe7eabd0a0bb13d0f689deb
3
+ size 3182393952
rogue-enchantress-32k-7B-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7cde2529c0fc5212154ee531366c489b7bf410272eca8359cff72aee2c594dc
3
+ size 2827344480
rogue-enchantress-32k-7B-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c01f8a2a5fad460d4535f67f87fd56415274ab37c3f4d1860a7a489d9b0dd68f
3
+ size 4125694560
rogue-enchantress-32k-7B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60e5f0db342162df91a4fcc3c3747f05ec79ef8c80abfcce666be27236c2ac4b
3
+ size 3907689056
rogue-enchantress-32k-7B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e19cb4fdfbf2d57ea75dabe70c0e7c889f8d45a6a794b88eb3b6d00da56ef798
3
+ size 4368439904
rogue-enchantress-32k-7B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b1fd6790fbffc13af0e64c33e986508d591ecc08a6a22b9cb97e652839e3f65
3
+ size 4140374624
rogue-enchantress-32k-7B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8f30d1ad356931ed6d055ca4c91e8db12ce9dc8895f2dadd9c17cff9b495c9e
3
+ size 5131410016
rogue-enchantress-32k-7B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a056e11d8c9e52a9597fbac760120eca47ed079dd7815a39e9081d38d6917c2
3
+ size 4997716576
rogue-enchantress-32k-7B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b020814fb49ec54b413871d3e2db9bfa2e6218d005073945754b22f0c06433d7
3
+ size 5942065760
rogue-enchantress-32k-7B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a95c46ceec019a45789ad90f0bfbefbcf981f153786b7dd637504435b8f7540
3
+ size 7695858272