PEFT
Safetensors
henryen commited on
Commit
293270e
1 Parent(s): 2495d98

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -3
README.md CHANGED
@@ -28,9 +28,7 @@ conda activate origen
28
  pip install -r requirements.txt
29
  ```
30
 
31
- Here is an example of how to use the model. Please note that the base model, DeepSeek Coder 7B, is loaded in float16 precision though the its default precision is bfloat16.
32
-
33
- The reason for this is that we find Lora trained in float16 performs better than that in bfloat16 in experiments.
34
 
35
  ```python
36
  from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
 
28
  pip install -r requirements.txt
29
  ```
30
 
31
+ Here is an example of how to use the model. Please note that the base model, DeepSeek Coder 7B, is loaded in float16 precision, even though its default precision is bfloat16. This choice was made because our experiments showed that Lora trained in float16 outperforms those trained in bfloat16.
 
 
32
 
33
  ```python
34
  from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer