Update README.md

README.md

@@ -56,7 +56,8 @@ response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
 
 # Notes:
 - For small datasets with narrow content which the model already has well, and doesn't want the model to forget the knowledge by focusing on o. 
-- Fine-tuned lora with rank = 16 and alpha = 32, epoch = 1
-
+- Fine-tuned lora with rank = 16 and alpha = 32, epoch = 1, linear (optim)
+- DoRA
+  
 # Improvement
 - Increasing rank can help the model do better at robust structure.