Ahmedhany216 commited on
Commit
daa2955
1 Parent(s): 3fb9c43

End of training

Browse files
README.md ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: CAMeL-Lab/bert-base-arabic-camelbert-msa
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - accuracy
9
+ - f1
10
+ - precision
11
+ - recall
12
+ model-index:
13
+ - name: Monglish_Arabic_FAQ-V3
14
+ results: []
15
+ ---
16
+
17
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+ # Monglish_Arabic_FAQ-V3
21
+
22
+ This model is a fine-tuned version of [CAMeL-Lab/bert-base-arabic-camelbert-msa](https://huggingface.co/CAMeL-Lab/bert-base-arabic-camelbert-msa) on an unknown dataset.
23
+ It achieves the following results on the evaluation set:
24
+ - Loss: 0.3059
25
+ - Accuracy: 0.9558
26
+ - F1: 0.9520
27
+ - Precision: 0.9674
28
+ - Recall: 0.9558
29
+
30
+ ## Model description
31
+
32
+ More information needed
33
+
34
+ ## Intended uses & limitations
35
+
36
+ More information needed
37
+
38
+ ## Training and evaluation data
39
+
40
+ More information needed
41
+
42
+ ## Training procedure
43
+
44
+ ### Training hyperparameters
45
+
46
+ The following hyperparameters were used during training:
47
+ - learning_rate: 2e-05
48
+ - train_batch_size: 4
49
+ - eval_batch_size: 4
50
+ - seed: 42
51
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
+ - lr_scheduler_type: linear
53
+ - num_epochs: 15
54
+
55
+ ### Training results
56
+
57
+ | Training Loss | Epoch | Step | Accuracy | F1 | Validation Loss | Precision | Recall |
58
+ |:-------------:|:-----:|:----:|:--------:|:------:|:---------------:|:---------:|:------:|
59
+ | 1.1065 | 1.0 | 226 | 0.8850 | 0.8681 | 1.0925 | 0.9284 | 0.8850 |
60
+ | 0.12 | 2.0 | 452 | 0.3676 | 0.9381 | 0.9392 | 0.9639 | 0.9381 |
61
+ | 0.0403 | 3.0 | 678 | 0.2427 | 0.9558 | 0.9562 | 0.9705 | 0.9558 |
62
+ | 0.0179 | 4.0 | 904 | 0.2722 | 0.9469 | 0.9443 | 0.9645 | 0.9469 |
63
+ | 0.0129 | 5.0 | 1130 | 0.2694 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
64
+ | 0.0151 | 6.0 | 1356 | 0.2493 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
65
+ | 0.0046 | 7.0 | 1582 | 0.2811 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
66
+ | 0.0036 | 8.0 | 1808 | 0.2630 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
67
+ | 0.0051 | 9.0 | 2034 | 0.2787 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
68
+ | 0.0038 | 10.0 | 2260 | 0.2924 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
69
+ | 0.0027 | 11.0 | 2486 | 0.3098 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
70
+ | 0.0034 | 12.0 | 2712 | 0.3010 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
71
+ | 0.0046 | 13.0 | 2938 | 0.3051 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
72
+ | 0.0033 | 14.0 | 3164 | 0.3070 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
73
+ | 0.0016 | 15.0 | 3390 | 0.3059 | 0.9558 | 0.9520 | 0.9674 | 0.9558 |
74
+
75
+
76
+ ### Framework versions
77
+
78
+ - Transformers 4.44.2
79
+ - Pytorch 2.4.1+cu121
80
+ - Datasets 3.0.0
81
+ - Tokenizers 0.19.1
runs/Sep24_13-39-02_94e5570e14ec/events.out.tfevents.1727185144.94e5570e14ec.206.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3cb0b9303c0c323d1e9e11b87b10607a279d20770dd636b09015f9b596be7c58
3
- size 680070
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f7d2f73ec84040cb57579d4aed696653ae1a87dce4068d2aa29aab74b3e71d6
3
+ size 680896
runs/Sep24_13-39-02_94e5570e14ec/events.out.tfevents.1727186768.94e5570e14ec.206.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a9caf18bb9216602557f421a76229bba2068f32821484eca564e0c8e105b8e3
3
+ size 560