Hugging Face's logo

bartowski
/
OpenCerebrum-1.0-7b-DPO-GGUF

Text Generation
GGUF
English
open-source
code
math
chemistry
biology
question-answering
Inference Endpoints
Model card Files Community
bartowski commited on
Commit
6ec3134
•
1 Parent(s): c8ea65f

Llamacpp quants

Browse files
Files changed (18) hide show
  1. .gitattributes +16 -0
  2. OpenCerebrum-1.0-7b-DPO-IQ3_M.gguf +3 -0
  3. OpenCerebrum-1.0-7b-DPO-IQ3_S.gguf +3 -0
  4. OpenCerebrum-1.0-7b-DPO-IQ4_NL.gguf +3 -0
  5. OpenCerebrum-1.0-7b-DPO-IQ4_XS.gguf +3 -0
  6. OpenCerebrum-1.0-7b-DPO-Q2_K.gguf +3 -0
  7. OpenCerebrum-1.0-7b-DPO-Q3_K_L.gguf +3 -0
  8. OpenCerebrum-1.0-7b-DPO-Q3_K_M.gguf +3 -0
  9. OpenCerebrum-1.0-7b-DPO-Q3_K_S.gguf +3 -0
  10. OpenCerebrum-1.0-7b-DPO-Q4_0.gguf +3 -0
  11. OpenCerebrum-1.0-7b-DPO-Q4_K_M.gguf +3 -0
  12. OpenCerebrum-1.0-7b-DPO-Q4_K_S.gguf +3 -0
  13. OpenCerebrum-1.0-7b-DPO-Q5_0.gguf +3 -0
  14. OpenCerebrum-1.0-7b-DPO-Q5_K_M.gguf +3 -0
  15. OpenCerebrum-1.0-7b-DPO-Q5_K_S.gguf +3 -0
  16. OpenCerebrum-1.0-7b-DPO-Q6_K.gguf +3 -0
  17. OpenCerebrum-1.0-7b-DPO-Q8_0.gguf +3 -0
  18. README.md +46 -0
.gitattributes CHANGED
@@ -33,3 +33,19 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ OpenCerebrum-1.0-7b-DPO-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ OpenCerebrum-1.0-7b-DPO-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ OpenCerebrum-1.0-7b-DPO-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
39
+ OpenCerebrum-1.0-7b-DPO-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ OpenCerebrum-1.0-7b-DPO-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ OpenCerebrum-1.0-7b-DPO-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
42
+ OpenCerebrum-1.0-7b-DPO-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ OpenCerebrum-1.0-7b-DPO-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ OpenCerebrum-1.0-7b-DPO-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
45
+ OpenCerebrum-1.0-7b-DPO-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ OpenCerebrum-1.0-7b-DPO-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
47
+ OpenCerebrum-1.0-7b-DPO-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
48
+ OpenCerebrum-1.0-7b-DPO-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
49
+ OpenCerebrum-1.0-7b-DPO-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ OpenCerebrum-1.0-7b-DPO-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
51
+ OpenCerebrum-1.0-7b-DPO-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
OpenCerebrum-1.0-7b-DPO-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f278b94f2c45d4bcb95d334786e45b042fdcb3be8502c5220457639bd7a52ad
3
+ size 3284891424
OpenCerebrum-1.0-7b-DPO-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d7586e65fcd5d5826e93749b7b839fceaa6b3dd99fba7a2818fcb5b0abd1325
3
+ size 3182393120
OpenCerebrum-1.0-7b-DPO-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c452e7954ac07da743f786025b7517bac65dc9d67ea7e0770f5b7a4ac311dcd6
3
+ size 4155053856
OpenCerebrum-1.0-7b-DPO-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2aab81a07a6985525325c68c50b8dd932ce8de517068a6d7b78d45f9aa101ae
3
+ size 3944388384
OpenCerebrum-1.0-7b-DPO-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5805a7c59da3fbbb0dfeb2bcca26b529ccd2ad7b8c7f86b74c154aa827914e9
3
+ size 2719242016
OpenCerebrum-1.0-7b-DPO-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:323cb7bd3700b1f13883d4c66d4054247b189e02c0c3806bbc0d7cda02ec482e
3
+ size 3822024480
OpenCerebrum-1.0-7b-DPO-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f90f0787589d0886444b9040d90d0ddcf277dbabb221839a590e1c6510c47eb
3
+ size 3518986016
OpenCerebrum-1.0-7b-DPO-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a1f2be996c1efb8cad6ff5563b22a5c397df729380896f61ea1ccaab7b579a5
3
+ size 3164567328
OpenCerebrum-1.0-7b-DPO-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00c0d4deda954ea85d8f1b8767fae9cd48b531f592913eae0812f8fc8fa61661
3
+ size 4108916512
OpenCerebrum-1.0-7b-DPO-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf1f97d5ec5e111671432316b82fe93288feb0e7649fedaab92e19728e550d27
3
+ size 4368439072
OpenCerebrum-1.0-7b-DPO-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b466686f5c3a0667e606064cbb2ca01165c5877f01da16ce6c1ffed05fbf9669
3
+ size 4140373792
OpenCerebrum-1.0-7b-DPO-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:369e9d366853941cb2295cf63dd26d970ba08471054f2bfced8457090f16a734
3
+ size 4997715744
OpenCerebrum-1.0-7b-DPO-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05899681ae1defb5018b3fe0318f98ae72503685cebb30aa14f87077b18519bb
3
+ size 5131409184
OpenCerebrum-1.0-7b-DPO-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9175d1dcd893937db940c8aa5630c24e9462b8768bd6b0254fde54bf51a6a2ba
3
+ size 4997715744
OpenCerebrum-1.0-7b-DPO-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6e2a3bfb2d3537b407f8fa48b6463b4d1f0ffd0d6b506cc60aa278ecb913e05
3
+ size 5942064928
OpenCerebrum-1.0-7b-DPO-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0323f36bd0d6cb7b99e4f561a5b9506b3a8d5bd2a3dfa93210d785179df9c8e8
3
+ size 7695857440
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ tags:
6
+ - open-source
7
+ - code
8
+ - math
9
+ - chemistry
10
+ - biology
11
+ - text-generation
12
+ - question-answering
13
+ datasets:
14
+ - Locutusque/OpenCerebrum-dpo
15
+ pipeline_tag: text-generation
16
+ quantized_by: bartowski
17
+ ---
18
+
19
+ ## Llamacpp Quantizations of OpenCerebrum-1.0-7b-DPO
20
+
21
+ Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b2536">b2536</a> for quantization.
22
+
23
+ Original model: https://huggingface.co/Locutusque/OpenCerebrum-1.0-7b-DPO
24
+
25
+ Download a file (not the whole branch) from below:
26
+
27
+ | Filename | Quant type | File Size | Description |
28
+ | -------- | ---------- | --------- | ----------- |
29
+ | [OpenCerebrum-1.0-7b-DPO-Q8_0.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q8_0.gguf) | Q8_0 | 7.69GB | Extremely high quality, generally unneeded but max available quant. |
30
+ | [OpenCerebrum-1.0-7b-DPO-Q6_K.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q6_K.gguf) | Q6_K | 5.94GB | Very high quality, near perfect, *recommended*. |
31
+ | [OpenCerebrum-1.0-7b-DPO-Q5_K_M.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q5_K_M.gguf) | Q5_K_M | 5.13GB | High quality, very usable. |
32
+ | [OpenCerebrum-1.0-7b-DPO-Q5_K_S.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q5_K_S.gguf) | Q5_K_S | 4.99GB | High quality, very usable. |
33
+ | [OpenCerebrum-1.0-7b-DPO-Q5_0.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q5_0.gguf) | Q5_0 | 4.99GB | High quality, older format, generally not recommended. |
34
+ | [OpenCerebrum-1.0-7b-DPO-Q4_K_M.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q4_K_M.gguf) | Q4_K_M | 4.36GB | Good quality, uses about 4.83 bits per weight. |
35
+ | [OpenCerebrum-1.0-7b-DPO-Q4_K_S.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q4_K_S.gguf) | Q4_K_S | 4.14GB | Slightly lower quality with small space savings. |
36
+ | [OpenCerebrum-1.0-7b-DPO-IQ4_NL.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-IQ4_NL.gguf) | IQ4_NL | 4.15GB | Decent quality, similar to Q4_K_S, new method of quanting, |
37
+ | [OpenCerebrum-1.0-7b-DPO-IQ4_XS.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-IQ4_XS.gguf) | IQ4_XS | 3.94GB | Decent quality, new method with similar performance to Q4. |
38
+ | [OpenCerebrum-1.0-7b-DPO-Q4_0.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q4_0.gguf) | Q4_0 | 4.10GB | Decent quality, older format, generally not recommended. |
39
+ | [OpenCerebrum-1.0-7b-DPO-Q3_K_L.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q3_K_L.gguf) | Q3_K_L | 3.82GB | Lower quality but usable, good for low RAM availability. |
40
+ | [OpenCerebrum-1.0-7b-DPO-Q3_K_M.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q3_K_M.gguf) | Q3_K_M | 3.51GB | Even lower quality. |
41
+ | [OpenCerebrum-1.0-7b-DPO-IQ3_M.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-IQ3_M.gguf) | IQ3_M | 3.28GB | Medium-low quality, new method with decent performance. |
42
+ | [OpenCerebrum-1.0-7b-DPO-IQ3_S.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-IQ3_S.gguf) | IQ3_S | 3.18GB | Lower quality, new method with decent performance, recommended over Q3 quants. |
43
+ | [OpenCerebrum-1.0-7b-DPO-Q3_K_S.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q3_K_S.gguf) | Q3_K_S | 3.16GB | Low quality, not recommended. |
44
+ | [OpenCerebrum-1.0-7b-DPO-Q2_K.gguf](https://huggingface.co/bartowski/OpenCerebrum-1.0-7b-DPO-GGUF/blob/main/OpenCerebrum-1.0-7b-DPO-Q2_K.gguf) | Q2_K | 2.71GB | Extremely low quality, *not* recommended.
45
+
46
+ Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski