Hugging Face's logo

VoTrongTinh
/
nlp_vietnamese_spelling

Text2Text Generation
Transformers
TensorBoard
Safetensors
mbart
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
VoTrongTinh commited on
Commit
37e4ed6
•
1 Parent(s): e153b1d

Training complete

Browse files
Files changed (4) hide show
  1. README.md +21 -14
  2. generation_config.json +1 -1
  3. model.safetensors +1 -1
  4. runs/May15_15-29-38_f773e40e2c5c/events.out.tfevents.1715786996.f773e40e2c5c.34.0 +2 -2
README.md CHANGED
@@ -1,4 +1,5 @@
1
  ---
 
2
  tags:
3
  - text2text-generation
4
  - generated_from_trainer
@@ -14,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # nlp_vietnamese_spelling
16
 
17
- This model was trained from scratch on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.0910
20
- - Sacrebleu: 20.7774
21
 
22
  ## Model description
23
 
@@ -47,18 +48,24 @@ The following hyperparameters were used during training:
47
 
48
  ### Training results
49
 
50
- | Training Loss | Epoch | Step | Validation Loss | Sacrebleu |
51
- |:-------------:|:------:|:----:|:---------------:|:---------:|
52
- | 0.2706 | 0.5402 | 1000 | 0.1371 | 19.8449 |
53
- | 0.2219 | 1.0805 | 2000 | 0.1153 | 20.2611 |
54
- | 0.1576 | 1.6207 | 3000 | 0.1011 | 20.5536 |
55
- | 0.1252 | 2.1610 | 4000 | 0.0945 | 20.7503 |
56
- | 0.1041 | 2.7012 | 5000 | 0.0910 | 20.7774 |
 
 
 
 
 
 
57
 
58
 
59
  ### Framework versions
60
 
61
- - Transformers 4.40.2
62
- - Pytorch 2.2.1+cu121
63
- - Datasets 2.19.1
64
- - Tokenizers 0.19.1
 
1
  ---
2
+ base_model: vinai/bartpho-syllable
3
  tags:
4
  - text2text-generation
5
  - generated_from_trainer
 
15
 
16
  # nlp_vietnamese_spelling
17
 
18
+ This model is a fine-tuned version of [vinai/bartpho-syllable](https://huggingface.co/vinai/bartpho-syllable) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.1084
21
+ - Sacrebleu: 19.1727
22
 
23
  ## Model description
24
 
 
48
 
49
  ### Training results
50
 
51
+ | Training Loss | Epoch | Step | Validation Loss | Sacrebleu |
52
+ |:-------------:|:-----:|:-----:|:---------------:|:---------:|
53
+ | 1.0565 | 0.25 | 1000 | 0.4944 | 13.1438 |
54
+ | 0.5878 | 0.5 | 2000 | 0.2775 | 16.2433 |
55
+ | 0.4367 | 0.75 | 3000 | 0.2222 | 17.0610 |
56
+ | 0.3627 | 1.0 | 4000 | 0.1793 | 17.9412 |
57
+ | 0.2672 | 1.25 | 5000 | 0.1533 | 18.3610 |
58
+ | 0.2305 | 1.5 | 6000 | 0.1429 | 18.4508 |
59
+ | 0.2164 | 1.75 | 7000 | 0.1296 | 18.8490 |
60
+ | 0.1948 | 2.01 | 8000 | 0.1205 | 19.0083 |
61
+ | 0.1537 | 2.26 | 9000 | 0.1167 | 19.0106 |
62
+ | 0.1491 | 2.51 | 10000 | 0.1131 | 19.0764 |
63
+ | 0.1414 | 2.76 | 11000 | 0.1084 | 19.1727 |
64
 
65
 
66
  ### Framework versions
67
 
68
+ - Transformers 4.39.3
69
+ - Pytorch 2.1.2
70
+ - Datasets 2.18.0
71
+ - Tokenizers 0.15.2
generation_config.json CHANGED
@@ -4,5 +4,5 @@
4
  "eos_token_id": 2,
5
  "forced_eos_token_id": 2,
6
  "pad_token_id": 1,
7
- "transformers_version": "4.40.2"
8
  }
 
4
  "eos_token_id": 2,
5
  "forced_eos_token_id": 2,
6
  "pad_token_id": 1,
7
+ "transformers_version": "4.39.3"
8
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:79e3ff5e24371fe0e478acfa1126784542ee99ad571bb9051b8f60d090311360
3
  size 1583480280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd5e7e90762829b453637cc1815cbf76b64f14a3b1a8ee80d61cc43059a595ef
3
  size 1583480280
runs/May15_15-29-38_f773e40e2c5c/events.out.tfevents.1715786996.f773e40e2c5c.34.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fdb3f8e3f4349df66e2d0e6198a00a838c8781a8944f7d401bf1a7fd5cba38ed
3
- size 10462
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:507f268483ad32e32cb6730b8cad7b90351d1286504c0a23aff4d331d40df7ec
3
+ size 11351