End of training

README.md

@@ -0,0 +1,59 @@
+---
+license: apache-2.0
+library_name: peft
+tags:
+- trl
+- sft
+- generated_from_trainer
+base_model: tiiuae/falcon-7b
+model-index:
+- name: Falcon-Complete-8-15
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# Falcon-Complete-8-15
+
+This model is a fine-tuned version of [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 2.6751
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0002
+- train_batch_size: 2
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: constant
+- lr_scheduler_warmup_ratio: 0.03
+- num_epochs: 8
+
+### Training results
+
+
+
+### Framework versions
+
+- PEFT 0.12.0
+- Transformers 4.39.3
+- Pytorch 2.1.2
+- Datasets 2.18.0
+- Tokenizers 0.15.2

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:23765a815477cc337de12a9a62f0c105fd99878538f05582a91afbdb3454202d
+oid sha256:5c316219ea85fba0e542c52ca39d27f10ddd1ea4d9db2333d039cd563a2aa4fe
 size 2439332736

runs/Aug04_13-27-34_77fa68f1731e/events.out.tfevents.1722778241.77fa68f1731e.25.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e2334cd36815d109e6fde863c9abd382bd91cc3405913db03ee91e56113c6516
-size 57223
+oid sha256:437a89880c0b5518a16f95ca6a55d64027393772a188477760c65bd41a12384c
+size 57798

runs/Aug04_13-27-34_77fa68f1731e/events.out.tfevents.1722814011.77fa68f1731e.25.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f788f1842720925a34c4f3e7414f6add74d45a15725fda0ed597bab1beb13bc
+size 364

tokenizer.json

@@ -173,7 +173,6 @@
     "end_of_word_suffix": null,
     "fuse_unk": false,
     "byte_fallback": false,
-    "ignore_merges": false,
     "vocab": {
       ">>TITLE<<": 0,
       ">>ABSTRACT<<": 1,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7e0b62111bb3be16a4973106c50333299d43c4f15b3e69374ecef45e97942754
-size 5368
+oid sha256:319388fd69780bbc4c99ab327b8f1d2706728a955e3cc2e6c1fc1f2fb2c54b0c
+size 5176