Update README.md
Browse files
README.md
CHANGED
|
@@ -515,17 +515,6 @@ $ cargo run --example t5 --release -- \
|
|
| 515 |
--decode --temperature 0
|
| 516 |
```
|
| 517 |
|
| 518 |
-
We also provide a quantized model (1.65 GB vs the original 11.8 GB file):
|
| 519 |
-
|
| 520 |
-
```
|
| 521 |
-
cargo run --example quantized-t5 --release -- \
|
| 522 |
-
--model-id "jbochi/madlad400-10b-mt" --weight-file "model-q4k.gguf" \
|
| 523 |
-
--prompt "<2de> How are you, my friend?" \
|
| 524 |
-
--temperature 0
|
| 525 |
-
...
|
| 526 |
-
Wie geht es dir, mein Freund?
|
| 527 |
-
```
|
| 528 |
-
|
| 529 |
</details>
|
| 530 |
|
| 531 |
|
|
|
|
| 515 |
--decode --temperature 0
|
| 516 |
```
|
| 517 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 518 |
</details>
|
| 519 |
|
| 520 |
|