Update README.md
Browse files
README.md
CHANGED
@@ -15,12 +15,14 @@ tags:
|
|
15 |
<!-- Provide a quick summary of what the model is/does. -->
|
16 |
|
17 |
## ํ์ธ ํ๋ ๊ฐ์
|
18 |
-
-
|
19 |
- ๋ฐ์ดํฐ์
: heegyu/open-korean-instructions (10%)
|
20 |
-
- ํ๋ ๋ฐฉ๋ฒ
|
|
|
|
|
21 |
- ๊ด๋ จ ๋
ผ๋ฌธ : https://arxiv.org/abs/2106.09685
|
22 |
-
- Llama2 ๋ชจ๋ธ์ ํ๊ตญ์ด ์ฑ๋ด ๋ฐ์ดํฐ(open korean instructions)์
|
23 |
-
- ๋๊ท๋ชจ ์ธ์ด ๋ชจ๋ธ์ A30 GPU*1 ์์ ํ์ธ ํ๋์ด ๊ฐ๋ฅํ์ง ํ
์คํธ
|
24 |
|
25 |
<!-- Provide a longer summary of what this model is. -->
|
26 |
|
|
|
15 |
<!-- Provide a quick summary of what the model is/does. -->
|
16 |
|
17 |
## ํ์ธ ํ๋ ๊ฐ์
|
18 |
+
- ๊ธฐ๋ณธ ๋ชจ๋ธ : meta-llama/Llama-2-7b-hf
|
19 |
- ๋ฐ์ดํฐ์
: heegyu/open-korean-instructions (10%)
|
20 |
+
- ํ๋ ๋ฐฉ๋ฒ
|
21 |
+
- PEFT(Parameter Efficient Fine-Tuning)
|
22 |
+
- LoRA(Low-Rank Adaptation of Large Language Models)
|
23 |
- ๊ด๋ จ ๋
ผ๋ฌธ : https://arxiv.org/abs/2106.09685
|
24 |
+
- Llama2 ๋ชจ๋ธ์ ํ๊ตญ์ด ์ฑ๋ด ๋ฐ์ดํฐ(open korean instructions)์ ์์ 10%๋ก ํ์ธ ํ๋
|
25 |
+
- ๋๊ท๋ชจ ์ธ์ด ๋ชจ๋ธ์ A30 GPU*1 ์์ ํ์ธ ํ๋์ด ๊ฐ๋ฅํ์ง ํ
์คํธ (์ฑ๊ณต)
|
26 |
|
27 |
<!-- Provide a longer summary of what this model is. -->
|
28 |
|