Anthonyg5005 commited on
Commit
4f73fd2
1 Parent(s): c08cadd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md CHANGED
@@ -63,3 +63,53 @@ This model has the following harm categories:
63
  [6.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/6.0bpw)\
64
  [8.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/8.0bpw)\
65
  [measurement.json](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/blob/main/measurement.json)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
63
  [6.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/6.0bpw)\
64
  [8.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/8.0bpw)\
65
  [measurement.json](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/blob/main/measurement.json)
66
+
67
+ # How to download:
68
+
69
+ ### oobabooga's downloader
70
+
71
+ use something like [download-model.py](https://github.com/oobabooga/text-generation-webui/blob/main/download-model.py) to download with python requests.\
72
+ Install requirements:
73
+
74
+ ```shell
75
+ pip install requests tqdm
76
+ ```
77
+
78
+ Example for downloading 8bpw:
79
+
80
+ ```shell
81
+ python download-model.py Anthonyg5005/Meta-Llama-Guard-2-8B-exl2:8.0bpw
82
+ ```
83
+
84
+ ### huggingface-cli
85
+
86
+ You may also use huggingface-cli\
87
+ To install it, install python hf-hub
88
+
89
+ ```shell
90
+ pip install huggingface-hub
91
+ ```
92
+
93
+ Example for 8bpw:
94
+
95
+ ```shell
96
+ huggingface-cli download Anthonyg5005/Meta-Llama-Guard-2-8B-exl2 --local-dir Llama-Guard-2-8B-exl2-8bpw --revision 8.0bpw
97
+ ```
98
+ ### Git LFS (not recommended)
99
+
100
+ I would recommend the http downloaders over using git, they can resume downloads if failed and are much easier to work with.\
101
+ Make sure to have git and git LFS installed.\
102
+ Example for 8bpw download with git:
103
+
104
+ Have LFS file skip disabled
105
+ ```shell
106
+ # windows
107
+ set GIT_LFS_SKIP_SMUDGE=0
108
+ # linux
109
+ GIT_LFS_SKIP_SMUDGE=0
110
+ ```
111
+
112
+ Clone repo branch
113
+ ```shell
114
+ git clone https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2 -b 8.0bpw
115
+ ```