End of training

README.md

@@ -95,7 +95,7 @@ xformers_attention: null
 
 This model is a fine-tuned version of [oopsung/llama2-7b-n-ox-test-v1](https://huggingface.co/oopsung/llama2-7b-n-ox-test-v1) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.1717
+- Loss: 2.1707
 
 ## Model description
 
@@ -131,9 +131,9 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 2.4864        | 0.0002 | 1    | 3.1967          |
-| 3.3946        | 0.0007 | 3    | 3.0946          |
-| 1.8184        | 0.0014 | 6    | 2.6199          |
-| 1.7204        | 0.0022 | 9    | 2.1717          |
+| 3.3931        | 0.0007 | 3    | 3.0885          |
+| 1.8125        | 0.0014 | 6    | 2.6186          |
+| 1.7235        | 0.0022 | 9    | 2.1707          |
 
 
 ### Framework versions

adapter_config.json

@@ -20,13 +20,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "down_proj",
-    "gate_proj",
     "v_proj",
-    "o_proj",
     "k_proj",
-    "q_proj",
-    "up_proj"
+    "gate_proj",
+    "o_proj",
+    "down_proj",
+    "up_proj",
+    "q_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2dd9282afcd52729705db9e9b23c4d981d1d05cc3175b89e878bf6672486d25e
+oid sha256:d70f3f56e50690fb9941969b6c52c4cd9ba3c61d14d44c41156b2c8e2d75d839
 size 80115210

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:787efbd74eef37f370806a03f8001a6e532fc5e0610c35dba24a90fc1c51e77a
+oid sha256:eee58fcfc933c5b893ee33209f23fea23abe21f45cc727ed46f6d1d27c0edfd5
 size 80013120

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d9c99d0e2f5b8cc5e216c0a981ae420dfd0fdc085832d4176287c753653f2960
+oid sha256:c8e3eaba4fc887116ba05575a8a64bfbe0629dae4f12cb37cac79d895993962b
 size 6776