Hugging Face's logo

ZeroWw
/
Gemma-2-9B-It-SPPO-Iter3-GGUF

Text Generation
GGUF
English
Inference Endpoints
conversational
Model card Files Community
1
ZeroWw commited on
Commit
2ad0a70
•
1 Parent(s): 098885b

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +2 -0
  2. Gemma-2-9B-It-SPPO-Iter3.f16.gguf +2 -2
  3. Gemma-2-9B-It-SPPO-Iter3.q5_k.gguf +2 -2
  4. Gemma-2-9B-It-SPPO-Iter3.q6_k.gguf +2 -2
  5. Gemma-2-9B-It-SPPO-Iter3.q8_0.gguf +2 -2
  6. Gemma-2-9B-It-SPPO-Iter3.q8_p.gguf +3 -0
  7. Gemma-2-9B-It-SPPO-Iter3.q8q4.gguf +3 -0
  8. README.md +3 -0
.gitattributes CHANGED
@@ -37,3 +37,5 @@ Gemma-2-9B-It-SPPO-Iter3.f16.gguf filter=lfs diff=lfs merge=lfs -text
37
  Gemma-2-9B-It-SPPO-Iter3.q5_k.gguf filter=lfs diff=lfs merge=lfs -text
38
  Gemma-2-9B-It-SPPO-Iter3.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
39
  Gemma-2-9B-It-SPPO-Iter3.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
37
  Gemma-2-9B-It-SPPO-Iter3.q5_k.gguf filter=lfs diff=lfs merge=lfs -text
38
  Gemma-2-9B-It-SPPO-Iter3.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
39
  Gemma-2-9B-It-SPPO-Iter3.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Gemma-2-9B-It-SPPO-Iter3.q8_p.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Gemma-2-9B-It-SPPO-Iter3.q8q4.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-9B-It-SPPO-Iter3.f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5ff4e2820ad48154eab809340cee4d5a656bd03f3126474a0d79906af48fa430
3
- size 18490680928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48703c731c388f7c070bf2d1b59bdb4b8eda60746a5bf29a3ddfd4d28858edec
3
+ size 18490680416
Gemma-2-9B-It-SPPO-Iter3.q5_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:475fb6ed10f20d7bbd73da8621dd2a5da3399185f67dadf6022952cf573827e8
3
- size 7729735264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48ba7bcf9263d0976035d5e5ab1f80801757c61665db5c7689929bb1649a07a2
3
+ size 7729734752
Gemma-2-9B-It-SPPO-Iter3.q6_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5e989f14e13f0c15e51d8f6b523e0aeaba182a8099e490c2d9642f9ee04fcb9f
3
- size 8671438432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43e43cebfba9136d6c3ff075073ee6aadb3d85733124588cfde5e34a06ef82e7
3
+ size 8671437920
Gemma-2-9B-It-SPPO-Iter3.q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fbfc4870dad8ad4c395dd65c3160ad6ff734352c52ec984cdd8d39663642c53c
3
- size 10687309408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcebe2dd9c0e172ccd6e5b5e166540fc85d5d591e60a9c97b3f0a0a545f6a029
3
+ size 10687308896
Gemma-2-9B-It-SPPO-Iter3.q8_p.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea3e9676c03f1f636373bdd5ad4df0cac3a53b8307d844bdc6174c94f59259ce
3
+ size 9827148896
Gemma-2-9B-It-SPPO-Iter3.q8q4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7d0597efcb341d81bf6ac215945229e26286a03e24c3457c0bc6e407318b7bd
3
+ size 5983265888
README.md CHANGED
@@ -3,6 +3,7 @@
3
  license: mit
4
  language:
5
  - en
 
6
  ---
7
 
8
  My own (ZeroWw) quantizations.
@@ -12,3 +13,5 @@ all other tensors quantized to q5_k or q6_k.
12
  Result:
13
  both f16.q6 and f16.q5 are smaller than q8_0 standard quantization
14
  and they perform as well as the pure f16.
 
 
 
3
  license: mit
4
  language:
5
  - en
6
+ pipeline_tag: text-generation
7
  ---
8
 
9
  My own (ZeroWw) quantizations.
 
13
  Result:
14
  both f16.q6 and f16.q5 are smaller than q8_0 standard quantization
15
  and they perform as well as the pure f16.
16
+
17
+ Updated on: Tue Aug 20, 08:52:15