Hugging Face's logo

Clevyby
/
Poppy-Porpoise-0.72-L3-8B-Q5_K_S-GGUF-iMatrix

Text Generation
Transformers
GGUF
llama
roleplay
conversational
text-generation-inference
Inference Endpoints
imatrix
Model card Files Community
Clevyby Lewdiculous commited on
Commit
e36f266
•
0 Parent(s):

Duplicate from Lewdiculous/Poppy_Porpoise-0.72-L3-8B-GGUF-IQ-Imatrix

Browse files

Co-authored-by: Lewdiculous <Lewdiculous@users.noreply.huggingface.co>

Files changed (16) hide show
  1. .gitattributes +48 -0
  2. Poppy_Porpoise-0.72-L3-8B-F16.gguf +3 -0
  3. Poppy_Porpoise-0.72-L3-8B-IQ3_M-imat.gguf +3 -0
  4. Poppy_Porpoise-0.72-L3-8B-IQ3_S-imat.gguf +3 -0
  5. Poppy_Porpoise-0.72-L3-8B-IQ3_XXS-imat.gguf +3 -0
  6. Poppy_Porpoise-0.72-L3-8B-IQ4_NL-imat.gguf +3 -0
  7. Poppy_Porpoise-0.72-L3-8B-IQ4_XS-imat.gguf +3 -0
  8. Poppy_Porpoise-0.72-L3-8B-Q4_K_M-imat.gguf +3 -0
  9. Poppy_Porpoise-0.72-L3-8B-Q4_K_S-imat.gguf +3 -0
  10. Poppy_Porpoise-0.72-L3-8B-Q5_K_M-imat.gguf +3 -0
  11. Poppy_Porpoise-0.72-L3-8B-Q5_K_S-imat.gguf +3 -0
  12. Poppy_Porpoise-0.72-L3-8B-Q6_K-imat.gguf +3 -0
  13. Poppy_Porpoise-0.72-L3-8B-Q8_0-imat.gguf +3 -0
  14. README.md +31 -0
  15. imatrix-with-rp-ex.txt +0 -0
  16. imatrix.dat +3 -0
.gitattributes ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Poppy_Porpoise-0.72-L3-8B-F16.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Poppy_Porpoise-0.72-L3-8B-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Poppy_Porpoise-0.72-L3-8B-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Poppy_Porpoise-0.72-L3-8B-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Poppy_Porpoise-0.72-L3-8B-IQ4_NL-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Poppy_Porpoise-0.72-L3-8B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Poppy_Porpoise-0.72-L3-8B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Poppy_Porpoise-0.72-L3-8B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Poppy_Porpoise-0.72-L3-8B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Poppy_Porpoise-0.72-L3-8B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Poppy_Porpoise-0.72-L3-8B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Poppy_Porpoise-0.72-L3-8B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
Poppy_Porpoise-0.72-L3-8B-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:918e13d63f2f7739c9f814d8ea2c438192eebd895b28f25994d4327387809fac
3
+ size 16068890432
Poppy_Porpoise-0.72-L3-8B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40cb2c2bd70e4b83cbe893e162b7a34c99a2943a651528b8fa3f617decd045f4
3
+ size 3784822976
Poppy_Porpoise-0.72-L3-8B-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7223b0a75a94ba788ea469e819a3297a2c4de32c31e10c57ac97f55b1067f70
3
+ size 3682324672
Poppy_Porpoise-0.72-L3-8B-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d0bb0ff8f763d6e6a77e655b77c8ef2c17b18b3dfc86145d9f20c4d32b2b80e
3
+ size 3274911936
Poppy_Porpoise-0.72-L3-8B-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e81f9c38fbe239a9e77690025bcb83396382d125790d5a13b1e2e83e33255cc4
3
+ size 4677988544
Poppy_Porpoise-0.72-L3-8B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0aaecbfadf5373a8a3f149873d3b97da4cb05070da2b1be5cc909178a03991ff
3
+ size 4447662272
Poppy_Porpoise-0.72-L3-8B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53743717f929f73aa4355229de114d9b81814cb2e83c6cc1c6517844da20bfd5
3
+ size 4920733888
Poppy_Porpoise-0.72-L3-8B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4260bc3ef84e74b7783a1fe128816a3828d02ee852d3bcafab36c7dae53af42
3
+ size 4692668608
Poppy_Porpoise-0.72-L3-8B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d31339693ee5af8010b3498b5010673f6826c9d0333556f23a8c2ba481349992
3
+ size 5732987072
Poppy_Porpoise-0.72-L3-8B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fb380764c6b9d8fe8401c873d251d1c1968d0ce9491c4e6d6e8b8adb96a7522
3
+ size 5599293632
Poppy_Porpoise-0.72-L3-8B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32e6d807c6f75d860bab2b7a6ba039bd5feec9474ff9f684fec8ac8f945fbfa7
3
+ size 6596006080
Poppy_Porpoise-0.72-L3-8B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:687558da79a6b6a854747ea57a740d13fa5067666a02e519f8a6a6076b50f72a
3
+ size 8540770496
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - roleplay
4
+ ---
5
+
6
+ > [!TIP]
7
+ > **Support:** <br>
8
+ > My upload speeds have been cooked and unstable lately. <br>
9
+ > Realistically I'd need to move to get a better provider. <br>
10
+ > If you **want** and you are able to, you can [**support that endeavor and others here (Ko-fi)**](https://ko-fi.com/Lewdiculous). I apologize for disrupting your experience.
11
+
12
+
13
+ GGUF-IQ-Imatrix quants for [ChaoticNeutrals/Poppy_Porpoise-0.72-L3-8B](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-0.72-L3-8B).
14
+
15
+ # Original model information by the author:
16
+
17
+ # "Poppy Porpoise" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.
18
+
19
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/_R1hvMt9_QSBRzlnzo_nY.png)
20
+
21
+ # Recomended ST Presets:(Updated for 0.72) [Porpoise Presets](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B/tree/main/Official%20Poppy%20Porpoise%20ST%20Presets)
22
+
23
+ If you want to use vision functionality:
24
+
25
+ * You must use the latest versions of [Koboldcpp](https://github.com/LostRuins/koboldcpp).
26
+
27
+ # To use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo. [Llava MMProj](https://huggingface.co/ChaoticNeutrals/LLaVA-Llama-3-8B-mmproj)
28
+
29
+ * You can load the **mmproj** by using the corresponding section in the interface:
30
+
31
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/UX6Ubss2EPNAT3SKGMLe0.png)
imatrix-with-rp-ex.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9eeeeecc1dfa1d604e964862becb40eb45b7e1389d38889f9f34e8bf3aff3712
3
+ size 4988193