Hugging Face's logo

MaziyarPanahi
/
LongAlign-13B-64k-GGUF

Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
Long Context
en
zh
dataset:THUDM/LongAlign-10k
arxiv:2401.18058
Inference Endpoints
text-generation-inference
Model card Files Community
MaziyarPanahi commited on
Commit
71e7f93
•
1 Parent(s): 1545523

Upload folder using huggingface_hub

Browse files
Files changed (11) hide show
  1. LongAlign-13B-64k.Q2_K.gguf +1 -1
  2. LongAlign-13B-64k.Q3_K_L.gguf +1 -1
  3. LongAlign-13B-64k.Q3_K_M.gguf +1 -1
  4. LongAlign-13B-64k.Q3_K_S.gguf +1 -1
  5. LongAlign-13B-64k.Q4_K_M.gguf +1 -1
  6. LongAlign-13B-64k.Q4_K_S.gguf +1 -1
  7. LongAlign-13B-64k.Q5_K_M.gguf +1 -1
  8. LongAlign-13B-64k.Q5_K_S.gguf +1 -1
  9. LongAlign-13B-64k.Q6_K.gguf +1 -1
  10. LongAlign-13B-64k.Q8_0.gguf +1 -1
  11. LongAlign-13B-64k.fp16.gguf +1 -1
LongAlign-13B-64k.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d7a5f94265138931b67a75972067c6b744b59f66b24ba340f3c0eadec5a01431
3
  size 4855782432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac08c0c57fce1504908f25059eb09542367b97b829cbc54f408637d13bda220b
3
  size 4855782432
LongAlign-13B-64k.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6eb0952da5358eed97398a97a001bd5fc39376a2c52791588e2830243e62aa36
3
  size 6931205152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b66b1df75dea8a006720726203ecf0f48dfcef0d56243af36af85d2fd6652506
3
  size 6931205152
LongAlign-13B-64k.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:da05954acfbf5188dfecae8c3b3d0d80d0e5d8580cafcf69dc0309df65457187
3
  size 6339415072
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32b168f2837c786cb5e970e52c967d5286a9a359ef459cf1a91aff7c95355746
3
  size 6339415072
LongAlign-13B-64k.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d8a4abd902f6a5635164db674c56be8e1751e710d0c94cee5af258d4e06c3dd5
3
  size 5660625952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05e18e87a906ad7a19b9ec152e211e3094b1545c64a54041ee5327be8c22611a
3
  size 5660625952
LongAlign-13B-64k.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dca6c2582b700022f7d40ffe36f78c0261bc308336a8862b105559e555b1c7cb
3
  size 7867776032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a868dd29db120b9016a2fbfc5681abccae1ea4b5f038519ef19f0edd7b6e9dd8
3
  size 7867776032
LongAlign-13B-64k.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5613dd13c1a13192b908d39f0eaccd22751659cfbb7a8e2c8c0c7aabb6efb424
3
  size 7424998432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6860536d9d4eb27ac9f199cd4e389c20eef6aed68008b2f6425a8b855ff88b4
3
  size 7424998432
LongAlign-13B-64k.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cb9251f7023a74c403fe3b897e0eff3d2f5efc780f69679d16e0cbbf131355e9
3
  size 9231907872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3f6a4f0e289ae0bb3dcfc6817b08dff42f13a393dfcbb8197885010c221107d
3
  size 9231907872
LongAlign-13B-64k.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c5609ae719d6aa34386c567d1cba0cb58231e3b79650d18c09787a4acc53fc9
3
  size 8974269472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1bf90094e57955508ba32c9ced00803e5cfcb297bded545cd9a0ed406b9d9f2
3
  size 8974269472
LongAlign-13B-64k.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a6e45343ec1f3772d35d8fecbf1d1a6d7191075320eae9af639b9a73725c21da
3
  size 10681297952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3c33782d3f68a81692cc0654227fb9de164cefd1562c71c82f781735420220b
3
  size 10681297952
LongAlign-13B-64k.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9054fc4f5ec7fc02825eee920bbdb9679b491f3c5e0ee4c93c6ce13b1dd976bc
3
  size 13834112032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38fc0b3a924660013e68319351ac88361e9eaf09c5f8ea84acf677c268cfda57
3
  size 13834112032
LongAlign-13B-64k.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:24f2e5a0195aab26335448bee4f50ca2ef4f657a4965f85cdf1170ee3b691403
3
  size 26038553600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e2243c717909baf60a85a5eea320f24512967c19789362028a9ff6632c8c02a
3
  size 26038553600