LEESM commited on
Commit
43368d5
โ€ข
1 Parent(s): a3cea18

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -15,12 +15,14 @@ tags:
15
  <!-- Provide a quick summary of what the model is/does. -->
16
 
17
  ## ํŒŒ์ธ ํŠœ๋‹ ๊ฐœ์š”
18
- - ๋Œ€์ƒ ๋ชจ๋ธ : meta-llama/Llama-2-7b-hf
19
  - ๋ฐ์ดํ„ฐ์…‹ : heegyu/open-korean-instructions (10%)
20
- - ํŠœ๋‹ ๋ฐฉ๋ฒ• : PEFT(Parameter Efficient Fine-Tuning) - LoRA(Low-Rank Adaptation of Large Language Models)
 
 
21
  - ๊ด€๋ จ ๋…ผ๋ฌธ : https://arxiv.org/abs/2106.09685
22
- - Llama2 ๋ชจ๋ธ์„ ํ•œ๊ตญ์–ด ์ฑ—๋ด‡ ๋ฐ์ดํ„ฐ(open korean instructions)์˜ ์ผ๋ถ€๋ฅผ ์ด์šฉํ•˜์—ฌ ํŒŒ์ธ ํŠœ๋‹ํ•œ ๋ชจ๋ธ
23
- - ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ์„ A30 GPU*1 ์—์„œ ํŒŒ์ธ ํŠœ๋‹์ด ๊ฐ€๋Šฅํ•œ์ง€ ํ…Œ์ŠคํŠธ
24
 
25
  <!-- Provide a longer summary of what this model is. -->
26
 
 
15
  <!-- Provide a quick summary of what the model is/does. -->
16
 
17
  ## ํŒŒ์ธ ํŠœ๋‹ ๊ฐœ์š”
18
+ - ๊ธฐ๋ณธ ๋ชจ๋ธ : meta-llama/Llama-2-7b-hf
19
  - ๋ฐ์ดํ„ฐ์…‹ : heegyu/open-korean-instructions (10%)
20
+ - ํŠœ๋‹ ๋ฐฉ๋ฒ•
21
+ - PEFT(Parameter Efficient Fine-Tuning)
22
+ - LoRA(Low-Rank Adaptation of Large Language Models)
23
  - ๊ด€๋ จ ๋…ผ๋ฌธ : https://arxiv.org/abs/2106.09685
24
+ - Llama2 ๋ชจ๋ธ์„ ํ•œ๊ตญ์–ด ์ฑ—๋ด‡ ๋ฐ์ดํ„ฐ(open korean instructions)์˜ ์ž„์˜ 10%๋กœ ํŒŒ์ธ ํŠœ๋‹
25
+ - ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ์„ A30 GPU*1 ์—์„œ ํŒŒ์ธ ํŠœ๋‹์ด ๊ฐ€๋Šฅํ•œ์ง€ ํ…Œ์ŠคํŠธ (์„ฑ๊ณต)
26
 
27
  <!-- Provide a longer summary of what this model is. -->
28