Hugging Face's logo

lmstudio-community
/
Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
PyTorch
facebook
meta
llama
llama-3
Inference Endpoints
Model card Files Community
13
bartowski commited on
Commit
42de8c2
•
1 Parent(s): db5637a

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +1 -0
  2. Meta-Llama-3.1-8B-Instruct-IQ4_XS.gguf +1 -1
  3. Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf +1 -1
  4. Meta-Llama-3.1-8B-Instruct-Q4_K_M-take2.gguf +3 -0
  5. Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf +1 -1
  6. Meta-Llama-3.1-8B-Instruct-Q6_K.gguf +1 -1
  7. Meta-Llama-3.1-8B-Instruct-Q8_0.gguf +1 -1
.gitattributes CHANGED
@@ -39,3 +39,4 @@ Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
  Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
  Meta-Llama-3.1-8B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
41
  Meta-Llama-3.1-8B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
39
  Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
  Meta-Llama-3.1-8B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
41
  Meta-Llama-3.1-8B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Meta-Llama-3.1-8B-Instruct-Q4_K_M-take2.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-8B-Instruct-IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3902b139416368d858d5dff2ee2d87b5eb34f2a9935db2ffd2f7274fa211d8f9
3
  size 4447663040
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a721abc3ea751c726c19c77bc69e6f88dcc884809919e5ccd4eb5b25aee9154e
3
  size 4447663040
Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3434e22c1160192c4be838c4f85053d7112a11e7e7ff455170ccca6384978e7e
3
  size 4321956800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb20ae6dabf11329ff0961efd452aab86b7bab9e1e55ed0fbf6dc399a7076705
3
  size 4321956800
Meta-Llama-3.1-8B-Instruct-Q4_K_M-take2.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:431354b8f6066accf13219106f1956ecf9a212089dea1fd18b416454f28ba421
3
+ size 4920734656
Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fdbd791fbe3f65494f308968b88b1bce28b76453fa264a2fff39f987a5bba9f
3
  size 5732987840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5dc6f12d9755fc844e4376f480bb3a41764fc5187f9aaace5ca37249f76d9b9
3
  size 5732987840
Meta-Llama-3.1-8B-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e98f666344520c67801c0b188035d1f50b8beebc31745d95c967d9f17c20b515
3
  size 6596006848
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d76a404660603d2b87c0e25ef161f61b360fa9217719a3d96a77d8cc53daac8
3
  size 6596006848
Meta-Llama-3.1-8B-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dcd637c360d411e6c842285a7625cb0476bbb5646f997bb28a9cb6420feb9bf8
3
  size 8540771264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57e32d66bb95fb50474eab5f5e20026be3917b7a295719c497f4153c0e111030
3
  size 8540771264