Aratako
/

c4ai-command-r-v01-japanese-instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Aratako commited on Apr 4

Commit

6441083

•

1 Parent(s): f4087c9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ RunpodでGPUサーバを借り、A6000x4で学習を行いました。主な学
 - lora_r: 64
 - lisa_alpha: 128
 - lora_dropout: 0.05
-- lora_target_modules: "q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj", "down_proj"
 - learning_rate: 2e-5
 - num_train_epochs: 10epochs
 - batch_size: 50

 - lora_r: 64
 - lisa_alpha: 128
 - lora_dropout: 0.05
+- lora_target_modules: ["q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj", "down_proj"]
 - learning_rate: 2e-5
 - num_train_epochs: 10epochs
 - batch_size: 50