QuietImpostor
commited on
Commit
•
7560135
1
Parent(s):
a15cdcc
Update README.md
Browse filesAdding further details to model card.
README.md
CHANGED
@@ -14,7 +14,20 @@ language:
|
|
14 |
### Pruning Details
|
15 |
|
16 |
This is a prune of [Llama 3 Refueled](https://www.huggingface.co/refuelai/llama-3-refueled) using [mergekit](https://github.com/cg123/mergekit) and [PruneMe](https://www.github.com/arcee-ai/PruneMe)
|
17 |
-
The model is
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
|
19 |
### Configuration
|
20 |
|
|
|
14 |
### Pruning Details
|
15 |
|
16 |
This is a prune of [Llama 3 Refueled](https://www.huggingface.co/refuelai/llama-3-refueled) using [mergekit](https://github.com/cg123/mergekit) and [PruneMe](https://www.github.com/arcee-ai/PruneMe)
|
17 |
+
The model is semi-tested, but still needs some debugging, namely with converting to GGUF, though I am working on that.
|
18 |
+
|
19 |
+
### Performance
|
20 |
+
After only 1 test because of lack of compute and for stupid long inference times on my 3060ti (8GB), it does show some interesting results.
|
21 |
+
Here's the response after being prompted "Hi!" using the [example from Meta](https://llama.meta.com/docs/model-cards-and-prompt-formats/meta-llama-3).
|
22 |
+
|
23 |
+
```model_response
|
24 |
+
vel tips and recommendations.user
|
25 |
+
Hi!assistant
|
26 |
+
Hi! I can help you find the best travel tips and recommendations for your next trip. Where you most interested to travel and what kind of activities you most to to the 9e sure, we can start and letiing 10e 11e 12e 13e 14e 15e 16e 17e 18e 19e 20e 21e 23e 24e 5e 6e 7e 8e 9e 10e 11e 12e 13e 14e 15e
|
27 |
+
```
|
28 |
+
|
29 |
+
Even without finetuning, the model still exhibits some extent of instruction following.
|
30 |
+
And fine-tuning is a WIP and I will update this when it's ready.
|
31 |
|
32 |
### Configuration
|
33 |
|