TheBloke commited on
Commit
dd60af4
1 Parent(s): cbd46f2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -8,9 +8,9 @@ These files are the result of merging the [delta weights](https://huggingface.co
8
 
9
  The code for merging is provided in the [WizardLM official Github repo](https://github.com/nlpxucan/WizardLM).
10
 
11
- The original WizardLM deltas are in float32, and this results in producing an HF repo that is also float32, and so much larger than a normal 7B Llama model.
12
 
13
- Therefore for this repo I converted the model to float16, to produce a standard size 7B model.
14
 
15
  This was done achieved by running **`model = model.half()`** prior to saving.
16
 
 
8
 
9
  The code for merging is provided in the [WizardLM official Github repo](https://github.com/nlpxucan/WizardLM).
10
 
11
+ The original WizardLM deltas are in float32, and this results in producing an HF repo that is also float32, and is much larger than a normal 7B Llama model.
12
 
13
+ Therefore for this repo I converted the merged model to float16, to produce a standard size 7B model.
14
 
15
  This was done achieved by running **`model = model.half()`** prior to saving.
16