Update README.md
Browse files
README.md
CHANGED
@@ -119,7 +119,7 @@ Refer to the Provided Files table below to see what files use which methods, and
|
|
119 |
I use the following command line; adjust for your tastes and needs:
|
120 |
|
121 |
```
|
122 |
-
./main -t 10 -ngl 32 -m orca-mini-7b.ggmlv3.q5_0.bin --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "###
|
123 |
```
|
124 |
If you're able to use full GPU offloading, you should use `-t 1` to get best performance.
|
125 |
|
|
|
119 |
I use the following command line; adjust for your tastes and needs:
|
120 |
|
121 |
```
|
122 |
+
./main -t 10 -ngl 32 -m orca-mini-7b.ggmlv3.q5_0.bin --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "### System:\nYou are an story writing assistant who writes very long, detailed and interesting stories\n\n### User:\nWrite a story about llamas\n\n### Input:\n{input}\n\n### Response:\n"
|
123 |
```
|
124 |
If you're able to use full GPU offloading, you should use `-t 1` to get best performance.
|
125 |
|