ptrdvn commited on
Commit
c77a920
1 Parent(s): aabc37c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -13
README.md CHANGED
@@ -17,18 +17,7 @@ Before running this model, please install the following pip package:
17
  pip install einops
18
  ```
19
 
20
- To run this model, you may need to load it in a lower precision in order for it to fit onto your GPU. We found for a T4 GPU, it requires loading the model in 8-bit precision. To load the model in 8-bit, please install the following pip packages:
21
-
22
- ```bash
23
- pip install bitsandbytes accelerate
24
- ```
25
-
26
- Caution - you will also need enough RAM to load the model. We estimate loading this model requires ~30GB.
27
-
28
- <details>
29
- <summary><b>Auto type</b></summary>
30
-
31
-
32
 
33
  ```python
34
  from transformers import AutoModelForCausalLM
@@ -41,7 +30,14 @@ model = AutoModelForCausalLM.from_pretrained(
41
  )
42
  ```
43
 
44
- </details>
 
 
 
 
 
 
 
45
  <details>
46
  <summary><b>In 8 bit</b></summary>
47
 
 
17
  pip install einops
18
  ```
19
 
20
+ To load the model, run the following command.
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  ```python
23
  from transformers import AutoModelForCausalLM
 
30
  )
31
  ```
32
 
33
+ To run this model, you may need to load it in a lower precision in order for it to fit onto your GPU. We found for a T4 GPU, it requires loading the model in 8-bit precision. To load the model in 8-bit, please install the following pip packages:
34
+
35
+ ```bash
36
+ pip install bitsandbytes accelerate
37
+ ```
38
+
39
+ Caution - you will also need enough RAM to load the model. We estimate loading this model requires ~30GB.
40
+
41
  <details>
42
  <summary><b>In 8 bit</b></summary>
43