End of training

README.md

@@ -1,11 +1,11 @@
 ---
-license: apache-2.0
+base_model: tiiuae/falcon-7b
 library_name: peft
+license: apache-2.0
 tags:
 - trl
 - sft
 - generated_from_trainer
-base_model: tiiuae/falcon-7b
 model-index:
 - name: Falcon-Complete-8-15
   results: []
@@ -14,11 +14,12 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/rug_thijs/huggingface/runs/occ6m0k5)
 # Falcon-Complete-8-15
 
 This model is a fine-tuned version of [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.6751
+- Loss: 2.7295
 
 ## Model description
 
@@ -53,7 +54,7 @@ The following hyperparameters were used during training:
 ### Framework versions
 
 - PEFT 0.12.0
-- Transformers 4.39.3
+- Transformers 4.42.3
 - Pytorch 2.1.2
-- Datasets 2.18.0
-- Tokenizers 0.15.2
+- Datasets 2.20.0
+- Tokenizers 0.19.1

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5c316219ea85fba0e542c52ca39d27f10ddd1ea4d9db2333d039cd563a2aa4fe
+oid sha256:23765a815477cc337de12a9a62f0c105fd99878538f05582a91afbdb3454202d
 size 2439332736

runs/Aug04_13-27-56_1aed02b492db/events.out.tfevents.1722814203.1aed02b492db.23.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de86d49d80968cc0d1eff66a3b806175418c4b7485b5eb7e962c3e9f9c04ad71
+size 364

tokenizer.json

@@ -173,6 +173,7 @@
     "end_of_word_suffix": null,
     "fuse_unk": false,
     "byte_fallback": false,
+    "ignore_merges": false,
     "vocab": {
       ">>TITLE<<": 0,
       ">>ABSTRACT<<": 1,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:319388fd69780bbc4c99ab327b8f1d2706728a955e3cc2e6c1fc1f2fb2c54b0c
-size 5176
+oid sha256:7e0b62111bb3be16a4973106c50333299d43c4f15b3e69374ecef45e97942754
+size 5368