Anthonyg5005
commited on
Commit
•
4f73fd2
1
Parent(s):
c08cadd
Update README.md
Browse files
README.md
CHANGED
@@ -63,3 +63,53 @@ This model has the following harm categories:
|
|
63 |
[6.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/6.0bpw)\
|
64 |
[8.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/8.0bpw)\
|
65 |
[measurement.json](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/blob/main/measurement.json)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
63 |
[6.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/6.0bpw)\
|
64 |
[8.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/8.0bpw)\
|
65 |
[measurement.json](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/blob/main/measurement.json)
|
66 |
+
|
67 |
+
# How to download:
|
68 |
+
|
69 |
+
### oobabooga's downloader
|
70 |
+
|
71 |
+
use something like [download-model.py](https://github.com/oobabooga/text-generation-webui/blob/main/download-model.py) to download with python requests.\
|
72 |
+
Install requirements:
|
73 |
+
|
74 |
+
```shell
|
75 |
+
pip install requests tqdm
|
76 |
+
```
|
77 |
+
|
78 |
+
Example for downloading 8bpw:
|
79 |
+
|
80 |
+
```shell
|
81 |
+
python download-model.py Anthonyg5005/Meta-Llama-Guard-2-8B-exl2:8.0bpw
|
82 |
+
```
|
83 |
+
|
84 |
+
### huggingface-cli
|
85 |
+
|
86 |
+
You may also use huggingface-cli\
|
87 |
+
To install it, install python hf-hub
|
88 |
+
|
89 |
+
```shell
|
90 |
+
pip install huggingface-hub
|
91 |
+
```
|
92 |
+
|
93 |
+
Example for 8bpw:
|
94 |
+
|
95 |
+
```shell
|
96 |
+
huggingface-cli download Anthonyg5005/Meta-Llama-Guard-2-8B-exl2 --local-dir Llama-Guard-2-8B-exl2-8bpw --revision 8.0bpw
|
97 |
+
```
|
98 |
+
### Git LFS (not recommended)
|
99 |
+
|
100 |
+
I would recommend the http downloaders over using git, they can resume downloads if failed and are much easier to work with.\
|
101 |
+
Make sure to have git and git LFS installed.\
|
102 |
+
Example for 8bpw download with git:
|
103 |
+
|
104 |
+
Have LFS file skip disabled
|
105 |
+
```shell
|
106 |
+
# windows
|
107 |
+
set GIT_LFS_SKIP_SMUDGE=0
|
108 |
+
# linux
|
109 |
+
GIT_LFS_SKIP_SMUDGE=0
|
110 |
+
```
|
111 |
+
|
112 |
+
Clone repo branch
|
113 |
+
```shell
|
114 |
+
git clone https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2 -b 8.0bpw
|
115 |
+
```
|