Hugging Face's logo

MarsupialAI
/
Buddy-2B-v1_iMatrix_GGUF

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
MarsupialAI commited on
Commit
da5cf41
•
1 Parent(s): 135416f

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Buddy-2B-v1_iQ2m.gguf +3 -0
  3. Buddy-2B-v1_iQ2xxs.gguf +3 -0
  4. Buddy-2B-v1_iQ3m.gguf +3 -0
  5. Buddy-2B-v1_iQ3xxs.gguf +3 -0
.gitattributes CHANGED
@@ -41,3 +41,7 @@ Buddy-2B-v1_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
41
  Buddy-2B-v1_Q5km.gguf filter=lfs diff=lfs merge=lfs -text
42
  Buddy-2B-v1_Q5ks.gguf filter=lfs diff=lfs merge=lfs -text
43
  Buddy-2B-v1_Q6k.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
41
  Buddy-2B-v1_Q5km.gguf filter=lfs diff=lfs merge=lfs -text
42
  Buddy-2B-v1_Q5ks.gguf filter=lfs diff=lfs merge=lfs -text
43
  Buddy-2B-v1_Q6k.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Buddy-2B-v1_iQ2m.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Buddy-2B-v1_iQ2xxs.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Buddy-2B-v1_iQ3m.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Buddy-2B-v1_iQ3xxs.gguf filter=lfs diff=lfs merge=lfs -text
Buddy-2B-v1_iQ2m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba0b730f6f3c8eb895ab9099a569e7df5c19ec7d028c03ae439f2b80bd4c8d42
3
+ size 1088014048
Buddy-2B-v1_iQ2xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e727ffa9a6e41e47b5330fd0d8d6aa964b09a5d5c97b2f6d5b11f2f9ec27c7ee
3
+ size 943193824
Buddy-2B-v1_iQ3m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58d09ece0f3132d83180ff8ac8225fa78f02d2b27e9720365a735edf8449ae91
3
+ size 1393561312
Buddy-2B-v1_iQ3xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfedfd3e759f78db508bbd7c8f09dad5fe0034669e932396091ea2f0f0aff9b7
3
+ size 1181685472