End of training

README.md

@@ -2,9 +2,17 @@
 library_name: transformers
 base_model: lamm-mit/mistral-7B-v0.3-Instruct-CPT_SFT
 tags:
+- alignment-handbook
 - trl
 - dpo
 - generated_from_trainer
+- trl
+- dpo
+- generated_from_trainer
+datasets:
+- lamm-mit/orpo-dpo-mix-40k
+- lamm-mit/bio-inspired-DPO
+- lamm-mit/spider-silk-DPO
 model-index:
 - name: mistral-7B-v0.3-Instruct-CPT_SFT-DPO
   results: []
@@ -15,7 +23,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # mistral-7B-v0.3-Instruct-CPT_SFT-DPO
 
-This model is a fine-tuned version of [lamm-mit/mistral-7B-v0.3-Instruct-CPT_SFT](https://huggingface.co/lamm-mit/mistral-7B-v0.3-Instruct-CPT_SFT) on the None dataset.
+This model is a fine-tuned version of [lamm-mit/mistral-7B-v0.3-Instruct-CPT_SFT](https://huggingface.co/lamm-mit/mistral-7B-v0.3-Instruct-CPT_SFT) on the lamm-mit/orpo-dpo-mix-40k, the lamm-mit/bio-inspired-DPO and the lamm-mit/spider-silk-DPO datasets.
 
 ## Model description
 

config.json

@@ -22,6 +22,6 @@
   "tie_word_embeddings": false,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.44.2",
-  "use_cache": false,
+  "use_cache": true,
   "vocab_size": 32768
 }