Hugging Face's logo

l3utterfly
/
Gemma-2-Ataraxy-9B-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
l3utterfly commited on
Commit
8ced2bd
•
1 Parent(s): 740b8ce

Add quantised GGUF files

Browse files
Files changed (9) hide show
  1. .gitattributes +1 -0
  2. Gemma-2-Ataraxy-9B-Q2_K.gguf +3 -0
  3. Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf +3 -0
  4. Gemma-2-Ataraxy-9B-Q4_0_4_8.gguf +3 -0
  5. Gemma-2-Ataraxy-9B-Q4_0_8_8.gguf +3 -0
  6. Gemma-2-Ataraxy-9B-Q4_K_M.gguf +3 -0
  7. Gemma-2-Ataraxy-9B-Q6_K.gguf +3 -0
  8. Gemma-2-Ataraxy-9B-Q8_0.gguf +3 -0
  9. Gemma-2-Ataraxy-9B-f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-Ataraxy-9B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83c5374e9e91fc101f99da1dc577d9374fee7ad5144435858918e85f483b177a
3
+ size 3805397856
Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a97961e5ebad31b506541c46107c8f6ee8b056726070dd36acb8bacc596e8218
3
+ size 5443142496
Gemma-2-Ataraxy-9B-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9e373ebab3eea3f0c840806b5da8f879b5675a6a54dc5850bca3de392257f38
3
+ size 5443142496
Gemma-2-Ataraxy-9B-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40c3240c479ef073de3cf2d9cd76657df96811706138c57cb625e7c8cd7c0220
3
+ size 5443142496
Gemma-2-Ataraxy-9B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f33bbc0245d667ca8eb747bd89c3e5a1bb2a247a2f8e23b5fbfbfd9f795fbbd
3
+ size 5761057632
Gemma-2-Ataraxy-9B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fec26f1a7b37d2d21cae69129520d24ee665cb2a826523416ac00084444e5ddc
3
+ size 7589069664
Gemma-2-Ataraxy-9B-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb531a00389d395835f387819053fb9ec9c5b09835bab8b525c94b7687b54fb5
3
+ size 9827148640
Gemma-2-Ataraxy-9B-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0dd3558b7302878248efee969485b6944ee5469d8c98fceea0a3d83d22850fa9
3
+ size 18490680160