beyoru commited on
Commit
5cf0e79
1 Parent(s): 893ca5f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -55,7 +55,7 @@ response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
55
  ```
56
 
57
  # Notes:
58
- - For small datasets with narrow content which the model already has well, and doesn't want the model to forget the knowledge => Just need to focus on o.
59
  - Fine-tuned lora with rank = 16 and alpha = 32, epoch = 1, linear (optim)
60
  - DoRA
61
 
 
55
  ```
56
 
57
  # Notes:
58
+ - For small datasets with narrow content which the model has already done well on our domain, and doesn't want the model to forget the knowledge => Just need to focus on q, o.
59
  - Fine-tuned lora with rank = 16 and alpha = 32, epoch = 1, linear (optim)
60
  - DoRA
61