Hugging Face's logo

Amna100
/
fold_2

Token Classification
Transformers
TensorBoard
Safetensors
deberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
Amna100 commited on
Commit
e0f4010
•
1 Parent(s): 0544e17

End of training

Browse files
Files changed (2) hide show
  1. README.md +19 -17
  2. model.safetensors +1 -1
README.md CHANGED
@@ -16,19 +16,21 @@ model-index:
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/amnasaeed100/FineTuning-ADE-Repeatedfold/runs/lvieenf2)
20
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/amnasaeed100/FineTuning-ADE-Repeatedfold/runs/fgis28rc)
21
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/amnasaeed100/FineTuning-ADE-Repeatedfold/runs/9tw0vsla)
 
 
22
  # fold_2
23
 
24
  This model is a fine-tuned version of [Amna100/PreTraining-MLM](https://huggingface.co/Amna100/PreTraining-MLM) on the None dataset.
25
  It achieves the following results on the evaluation set:
26
- - Loss: 0.0108
27
- - Precision: 0.6774
28
- - Recall: 0.616
29
- - F1: 0.6453
30
- - Accuracy: 0.9992
31
- - Roc Auc: 0.9952
32
  - Pr Auc: 0.9999
33
 
34
  ## Model description
@@ -54,22 +56,22 @@ The following hyperparameters were used during training:
54
  - seed: 42
55
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
56
  - lr_scheduler_type: linear
57
- - num_epochs: 10
58
 
59
  ### Training results
60
 
61
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy | Roc Auc | Pr Auc |
62
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|:-------:|:------:|
63
- | 0.0322 | 1.0 | 632 | 0.0118 | 0.6869 | 0.544 | 0.6071 | 0.9992 | 0.9956 | 0.9999 |
64
- | 0.0115 | 2.0 | 1264 | 0.0108 | 0.6774 | 0.616 | 0.6453 | 0.9992 | 0.9952 | 0.9999 |
65
- | 0.0071 | 3.0 | 1896 | 0.0115 | 0.6253 | 0.7387 | 0.6773 | 0.9992 | 0.9960 | 0.9999 |
66
- | 0.0028 | 4.0 | 2528 | 0.0134 | 0.7723 | 0.624 | 0.6903 | 0.9994 | 0.9943 | 0.9999 |
67
- | 0.0015 | 5.0 | 3160 | 0.0137 | 0.7240 | 0.7413 | 0.7325 | 0.9994 | 0.9938 | 0.9998 |
68
 
69
 
70
  ### Framework versions
71
 
72
- - Transformers 4.41.0.dev0
73
- - Pytorch 2.2.1+cu121
74
  - Datasets 2.19.1
75
  - Tokenizers 0.19.1
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/amnasaeed100/FineTuning-ADE-change2/runs/zkyqf4w8)
20
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/amnasaeed100/FineTuning-ADE-change2/runs/n6lnsbeg)
21
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/amnasaeed100/FineTuning-ADE-change2/runs/k9jhon43)
22
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/amnasaeed100/FineTuning-ADE-change2/runs/67sviuwh)
23
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/amnasaeed100/FineTuning-ADE-change2/runs/e4zmtw0z)
24
  # fold_2
25
 
26
  This model is a fine-tuned version of [Amna100/PreTraining-MLM](https://huggingface.co/Amna100/PreTraining-MLM) on the None dataset.
27
  It achieves the following results on the evaluation set:
28
+ - Loss: 0.0104
29
+ - Precision: 0.6792
30
+ - Recall: 0.5870
31
+ - F1: 0.6297
32
+ - Accuracy: 0.9993
33
+ - Roc Auc: 0.9967
34
  - Pr Auc: 0.9999
35
 
36
  ## Model description
 
56
  - seed: 42
57
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
58
  - lr_scheduler_type: linear
59
+ - num_epochs: 5
60
 
61
  ### Training results
62
 
63
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy | Roc Auc | Pr Auc |
64
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|:-------:|:------:|
65
+ | 0.0252 | 1.0 | 711 | 0.0159 | 0.4538 | 0.6413 | 0.5315 | 0.9988 | 0.9944 | 0.9998 |
66
+ | 0.0095 | 2.0 | 1422 | 0.0104 | 0.6792 | 0.5870 | 0.6297 | 0.9993 | 0.9967 | 0.9999 |
67
+ | 0.003 | 3.0 | 2133 | 0.0106 | 0.6432 | 0.6957 | 0.6684 | 0.9993 | 0.9973 | 0.9999 |
68
+ | 0.0024 | 4.0 | 2844 | 0.0126 | 0.7006 | 0.6739 | 0.6870 | 0.9994 | 0.9960 | 0.9999 |
69
+ | 0.0004 | 5.0 | 3555 | 0.0148 | 0.7239 | 0.6413 | 0.6801 | 0.9994 | 0.9954 | 0.9999 |
70
 
71
 
72
  ### Framework versions
73
 
74
+ - Transformers 4.42.0.dev0
75
+ - Pytorch 2.3.0+cu121
76
  - Datasets 2.19.1
77
  - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bbe16021d72a048b581d0296e2643a4898c40d78ec0111c6326c81d437f43620
3
  size 554446244
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9966f67f140841fb9ea53786612d3656d373b33f476a611ca7f8caa2d286f8f6
3
  size 554446244