Update README.md
Browse files
README.md
CHANGED
@@ -28,9 +28,7 @@ conda activate origen
|
|
28 |
pip install -r requirements.txt
|
29 |
```
|
30 |
|
31 |
-
Here is an example of how to use the model. Please note that the base model, DeepSeek Coder 7B, is loaded in float16 precision though
|
32 |
-
|
33 |
-
The reason for this is that we find Lora trained in float16 performs better than that in bfloat16 in experiments.
|
34 |
|
35 |
```python
|
36 |
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
|
|
|
28 |
pip install -r requirements.txt
|
29 |
```
|
30 |
|
31 |
+
Here is an example of how to use the model. Please note that the base model, DeepSeek Coder 7B, is loaded in float16 precision, even though its default precision is bfloat16. This choice was made because our experiments showed that Lora trained in float16 outperforms those trained in bfloat16.
|
|
|
|
|
32 |
|
33 |
```python
|
34 |
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
|