Hugging Face's logo

thusken
/
nb-bert-large-user-needs

Text Classification
Transformers
PyTorch
Safetensors
Norwegian
Norwegian Bokmål
Norwegian Nynorsk
bert
Generated from Trainer
Inference Endpoints
Model card Files Community
2
thusken commited on
Commit
1375511
•
1 Parent(s): ede3ffc

End of training

Browse files
Files changed (2) hide show
  1. README.md +91 -0
  2. pytorch_model.bin +1 -1
README.md ADDED
@@ -0,0 +1,91 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - accuracy
7
+ - f1
8
+ - precision
9
+ - recall
10
+ model-index:
11
+ - name: thusken/nb-bert-large-user-needs
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # thusken/nb-bert-large-user-needs
19
+
20
+ This model is a fine-tuned version of [NbAiLab/nb-bert-large](https://huggingface.co/NbAiLab/nb-bert-large) on the None dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 1.0102
23
+ - Accuracy: 0.8900
24
+ - F1: 0.8859
25
+ - Precision: 0.8883
26
+ - Recall: 0.8900
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 3e-05
46
+ - train_batch_size: 8
47
+ - eval_batch_size: 64
48
+ - seed: 42
49
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
+ - lr_scheduler_type: linear
51
+ - lr_scheduler_warmup_steps: 500
52
+ - num_epochs: 25
53
+ - mixed_precision_training: Native AMP
54
+
55
+ ### Training results
56
+
57
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
58
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
59
+ | No log | 1.0 | 195 | 0.6790 | 0.8082 | 0.7567 | 0.7679 | 0.8082 |
60
+ | No log | 2.0 | 390 | 0.5577 | 0.8465 | 0.8392 | 0.8364 | 0.8465 |
61
+ | 0.8651 | 3.0 | 585 | 0.5494 | 0.8338 | 0.8191 | 0.8145 | 0.8338 |
62
+ | 0.8651 | 4.0 | 780 | 0.5453 | 0.8517 | 0.8386 | 0.8293 | 0.8517 |
63
+ | 0.8651 | 5.0 | 975 | 0.8855 | 0.8491 | 0.8298 | 0.8444 | 0.8491 |
64
+ | 0.3707 | 6.0 | 1170 | 0.7282 | 0.8645 | 0.8526 | 0.8581 | 0.8645 |
65
+ | 0.3707 | 7.0 | 1365 | 0.8797 | 0.8619 | 0.8537 | 0.8573 | 0.8619 |
66
+ | 0.1092 | 8.0 | 1560 | 0.9120 | 0.8491 | 0.8520 | 0.8579 | 0.8491 |
67
+ | 0.1092 | 9.0 | 1755 | 1.0700 | 0.8696 | 0.8615 | 0.8669 | 0.8696 |
68
+ | 0.1092 | 10.0 | 1950 | 1.0599 | 0.8670 | 0.8654 | 0.8701 | 0.8670 |
69
+ | 0.0355 | 11.0 | 2145 | 1.0808 | 0.8670 | 0.8656 | 0.8685 | 0.8670 |
70
+ | 0.0355 | 12.0 | 2340 | 1.0102 | 0.8900 | 0.8859 | 0.8883 | 0.8900 |
71
+ | 0.0002 | 13.0 | 2535 | 1.0236 | 0.8849 | 0.8812 | 0.8824 | 0.8849 |
72
+ | 0.0002 | 14.0 | 2730 | 1.0358 | 0.8875 | 0.8833 | 0.8841 | 0.8875 |
73
+ | 0.0002 | 15.0 | 2925 | 1.0476 | 0.8875 | 0.8833 | 0.8841 | 0.8875 |
74
+ | 0.0001 | 16.0 | 3120 | 1.0559 | 0.8798 | 0.8764 | 0.8776 | 0.8798 |
75
+ | 0.0001 | 17.0 | 3315 | 1.0648 | 0.8798 | 0.8754 | 0.8765 | 0.8798 |
76
+ | 0.0001 | 18.0 | 3510 | 1.0720 | 0.8798 | 0.8754 | 0.8765 | 0.8798 |
77
+ | 0.0001 | 19.0 | 3705 | 1.0796 | 0.8824 | 0.8775 | 0.8783 | 0.8824 |
78
+ | 0.0001 | 20.0 | 3900 | 1.0862 | 0.8798 | 0.8739 | 0.8745 | 0.8798 |
79
+ | 0.0 | 21.0 | 4095 | 1.0917 | 0.8798 | 0.8739 | 0.8745 | 0.8798 |
80
+ | 0.0 | 22.0 | 4290 | 1.0973 | 0.8798 | 0.8739 | 0.8745 | 0.8798 |
81
+ | 0.0 | 23.0 | 4485 | 1.1007 | 0.8798 | 0.8739 | 0.8745 | 0.8798 |
82
+ | 0.0 | 24.0 | 4680 | 1.1029 | 0.8798 | 0.8739 | 0.8745 | 0.8798 |
83
+ | 0.0 | 25.0 | 4875 | 1.1037 | 0.8798 | 0.8739 | 0.8745 | 0.8798 |
84
+
85
+
86
+ ### Framework versions
87
+
88
+ - Transformers 4.17.0
89
+ - Pytorch 1.10.2+cu113
90
+ - Datasets 2.3.2
91
+ - Tokenizers 0.12.1
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bc2f14865a1d3b1b1a10cbf4a38e844794a78c0b71fedff2a89f40b514dcb05
3
  size 1420537581
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7de4a06678ab22a1bb4488c3ec9ab06a67228b6350625558f86e76006beb1f20
3
  size 1420537581