Update README.md
Browse files
README.md
CHANGED
@@ -21,7 +21,9 @@ datasets:
|
|
21 |
# Model description
|
22 |
Heidrun-Mistral-7B-chat is a chat-model based on [Heidrun-Mistral-7B-base](https://huggingface.co/Mabeck/Heidrun-Mistral-7B-base), finetuned on [danish-OpenHermes](https://huggingface.co/datasets/Mabeck/danish-OpenHermes) and [skoleGPT](https://huggingface.co/datasets/kobprof/skolegpt-instruct) for a instruction/chat format.
|
23 |
|
24 |
-
It achieved 35.66%+-0.85%/51.68+-0.63% on MMLU-Da in [ScandEval](https://github.com/ScandEval/ScandEval)
|
|
|
|
|
25 |
|
26 |
# Datasets
|
27 |
This model is trained on Danish instruction datasets [danish-OpenHermes](Mabeck/danish-OpenHermes) and [skoleGPT](https://huggingface.co/datasets/kobprof/skolegpt-instruct), which have not been safeguarded or alligned.
|
@@ -30,19 +32,38 @@ Most of the data has been machine-translated and may contain incorrect responses
|
|
30 |
|
31 |
# Samples
|
32 |
|
33 |
-
This model uses the ChatML format. Using other formats
|
34 |
-
ChatML format:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
```
|
36 |
-
|
37 |
-
|
38 |
-
|
39 |
-
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
-
|
45 |
-
|
|
|
|
|
|
|
|
|
|
|
46 |
```
|
47 |
|
48 |
# Uploaded model
|
|
|
21 |
# Model description
|
22 |
Heidrun-Mistral-7B-chat is a chat-model based on [Heidrun-Mistral-7B-base](https://huggingface.co/Mabeck/Heidrun-Mistral-7B-base), finetuned on [danish-OpenHermes](https://huggingface.co/datasets/Mabeck/danish-OpenHermes) and [skoleGPT](https://huggingface.co/datasets/kobprof/skolegpt-instruct) for a instruction/chat format.
|
23 |
|
24 |
+
It achieved 35.66%+-0.85%/51.68+-0.63% on MMLU-Da in [ScandEval](https://github.com/ScandEval/ScandEval) which is the best non-merged opensource model score to date (13/02/24).
|
25 |
+
|
26 |
+
Further evaluations will be tested.
|
27 |
|
28 |
# Datasets
|
29 |
This model is trained on Danish instruction datasets [danish-OpenHermes](Mabeck/danish-OpenHermes) and [skoleGPT](https://huggingface.co/datasets/kobprof/skolegpt-instruct), which have not been safeguarded or alligned.
|
|
|
32 |
|
33 |
# Samples
|
34 |
|
35 |
+
This model uses the ChatML format. Using other formats may degrade the model's performance.
|
36 |
+
Samples from the model using ChatML format:
|
37 |
+
```
|
38 |
+
"<s> <im_start>system
|
39 |
+
Du er en AI-hjælper. Du får en opgave fra en bruger hvor du kort og præcist skal forklare svaret.
|
40 |
+
<im_end>
|
41 |
+
<im_start>user
|
42 |
+
Hvilke 3 områder skal fokuseres på for at effektivt tackle klimaforandringer?
|
43 |
+
<im_end>
|
44 |
+
<im_start>assistant
|
45 |
+
1. Energiproduktion: Fokus på vedvarende energikilder som sol, vind og vandkraft for at reducere afhængigheden af fossile brændstoffer og minimere drivhusgasemissioner.
|
46 |
+
|
47 |
+
2. Transport: Fremme bæredygtige transportformer som offentlig transport, cykling og elektriske køretøjer for at reducere luftforurening og afhængigheden af fossile brændstoffer.
|
48 |
+
|
49 |
+
3. Skovbevarelse og affaldshåndtering: Fremme skovbevarelse og bæredygtig skovdrift for at fange kuldioxid og reducere drivhusgasemissioner, samt fremme genbrug og reducere affaldsproduktion for at mindske mængden af drivhusgasemissioner fra affald.
|
50 |
+
<im_end></s>"
|
51 |
```
|
52 |
+
|
53 |
+
```
|
54 |
+
"<s> <im_start>system
|
55 |
+
Du er en AI-hjælper. Du får en opgave fra en bruger hvor du kort og præcist skal forklare svaret.
|
56 |
+
<im_end>
|
57 |
+
<im_start>user
|
58 |
+
Hvilke 3 populære retter findes der i dansk madlavning?
|
59 |
+
<im_end>
|
60 |
+
<im_start>assistant
|
61 |
+
1. Smørrebrød: Smørrebrød er en populær dansk ret, der består af brød med forskellige toppings som røget laks, rejer, ost eller andre ingredienser.
|
62 |
+
|
63 |
+
2. Frikadeller: Frikadeller er en traditionel dansk ret lavet af kødboller af kalvekød, svinekød eller lam, krydret med krydderurter og kogt i smør eller olie.
|
64 |
+
|
65 |
+
3. Rød kål: Rød kål er en populær side ret i dansk madlavning.
|
66 |
+
<im_end></s>"
|
67 |
```
|
68 |
|
69 |
# Uploaded model
|