Adding IQ3_XXS and fixed _M models
Browse files
mixtral-8x7b-iq3-xxs.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a30e4b1c68b0ab327940c55542274f2ad4c4b60717f59e95e01f5597121554a4
|
| 3 |
+
size 18309713664
|
mixtral-8x7b-q3k-medium.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:acee9f11a1be6d3262123cb9f655d9c08d7ff20644320cdd2e261f456947766e
|
| 3 |
+
size 22545329920
|
mixtral-8x7b-q4k-medium.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4ecf46dd1ca7e1e4fe3a9889b56d1cf9e924fb09196b2c187baf1a8e972a020a
|
| 3 |
+
size 28447346432
|