Hugging Face's logo

zachwatanabe
/
test

Token Classification
Transformers
TensorBoard
Safetensors
layoutlmv3
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
zachwatanabe commited on
Commit
8bc55f5
•
1 Parent(s): d90d6a9

searchlightai/resume-token-classifier

Browse files
Files changed (21) hide show
  1. README.md +145 -0
  2. config.json +54 -0
  3. merges.txt +0 -0
  4. model.safetensors +3 -0
  5. preprocessor_config.json +27 -0
  6. runs/Dec20_05-48-01_a4b5ac2ed673/events.out.tfevents.1703051319.a4b5ac2ed673.27874.0 +3 -0
  7. runs/Dec20_06-25-15_a4b5ac2ed673/events.out.tfevents.1703053523.a4b5ac2ed673.36677.0 +3 -0
  8. runs/Dec20_06-27-05_a4b5ac2ed673/events.out.tfevents.1703053632.a4b5ac2ed673.36677.1 +3 -0
  9. runs/Dec20_06-28-08_a4b5ac2ed673/events.out.tfevents.1703053693.a4b5ac2ed673.36677.2 +3 -0
  10. runs/Dec20_06-29-31_a4b5ac2ed673/events.out.tfevents.1703053777.a4b5ac2ed673.36677.3 +3 -0
  11. runs/Dec20_06-30-09_a4b5ac2ed673/events.out.tfevents.1703053812.a4b5ac2ed673.36677.4 +3 -0
  12. runs/Dec20_06-31-02_a4b5ac2ed673/events.out.tfevents.1703053868.a4b5ac2ed673.36677.5 +3 -0
  13. runs/Dec20_06-31-36_a4b5ac2ed673/events.out.tfevents.1703053899.a4b5ac2ed673.36677.6 +3 -0
  14. runs/Dec20_06-31-36_a4b5ac2ed673/events.out.tfevents.1703053958.a4b5ac2ed673.36677.7 +3 -0
  15. runs/Dec20_06-35-04_a4b5ac2ed673/events.out.tfevents.1703054110.a4b5ac2ed673.36677.8 +3 -0
  16. runs/Dec20_07-19-58_a4b5ac2ed673/events.out.tfevents.1703056806.a4b5ac2ed673.36677.9 +3 -0
  17. special_tokens_map.json +51 -0
  18. tokenizer.json +0 -0
  19. tokenizer_config.json +79 -0
  20. training_args.bin +3 -0
  21. vocab.json +0 -0
README.md ADDED
@@ -0,0 +1,145 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-sa-4.0
3
+ base_model: microsoft/layoutlmv3-base
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - precision
8
+ - recall
9
+ - f1
10
+ - accuracy
11
+ model-index:
12
+ - name: test
13
+ results: []
14
+ ---
15
+
16
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
+ should probably proofread and complete it, then remove this comment. -->
18
+
19
+ # test
20
+
21
+ This model is a fine-tuned version of [microsoft/layoutlmv3-base](https://huggingface.co/microsoft/layoutlmv3-base) on an unknown dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 0.0314
24
+ - Precision: 0.0
25
+ - Recall: 0.0
26
+ - F1: 0.0
27
+ - Accuracy: 0.9933
28
+
29
+ ## Model description
30
+
31
+ More information needed
32
+
33
+ ## Intended uses & limitations
34
+
35
+ More information needed
36
+
37
+ ## Training and evaluation data
38
+
39
+ More information needed
40
+
41
+ ## Training procedure
42
+
43
+ ### Training hyperparameters
44
+
45
+ The following hyperparameters were used during training:
46
+ - learning_rate: 1e-05
47
+ - train_batch_size: 8
48
+ - eval_batch_size: 8
49
+ - seed: 42
50
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
+ - lr_scheduler_type: linear
52
+ - training_steps: 40000
53
+
54
+ ### Training results
55
+
56
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
+ |:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:---:|:--------:|
58
+ | 0.0381 | 0.13 | 500 | 0.0777 | 0.0 | 0.0 | 0.0 | 0.9745 |
59
+ | 0.0669 | 0.26 | 1000 | 0.0545 | 0.0 | 0.0 | 0.0 | 0.9790 |
60
+ | 0.0595 | 0.39 | 1500 | 0.0545 | 0.0 | 0.0 | 0.0 | 0.9803 |
61
+ | 0.054 | 0.52 | 2000 | 0.0555 | 0.0 | 0.0 | 0.0 | 0.9796 |
62
+ | 0.0502 | 0.65 | 2500 | 0.0451 | 0.0 | 0.0 | 0.0 | 0.9828 |
63
+ | 0.0474 | 0.78 | 3000 | 0.0486 | 0.0 | 0.0 | 0.0 | 0.9818 |
64
+ | 0.0458 | 0.92 | 3500 | 0.0417 | 0.0 | 0.0 | 0.0 | 0.9836 |
65
+ | 0.0415 | 1.05 | 4000 | 0.0440 | 0.0 | 0.0 | 0.0 | 0.9827 |
66
+ | 0.0372 | 1.18 | 4500 | 0.0432 | 0.0 | 0.0 | 0.0 | 0.9839 |
67
+ | 0.0391 | 1.31 | 5000 | 0.0442 | 0.0 | 0.0 | 0.0 | 0.9839 |
68
+ | 0.0368 | 1.44 | 5500 | 0.0377 | 0.0 | 0.0 | 0.0 | 0.9856 |
69
+ | 0.0388 | 1.57 | 6000 | 0.0417 | 0.0 | 0.0 | 0.0 | 0.9846 |
70
+ | 0.0351 | 1.7 | 6500 | 0.0363 | 0.0 | 0.0 | 0.0 | 0.9857 |
71
+ | 0.0357 | 1.83 | 7000 | 0.0383 | 0.0 | 0.0 | 0.0 | 0.9858 |
72
+ | 0.0336 | 1.96 | 7500 | 0.0371 | 0.0 | 0.0 | 0.0 | 0.9860 |
73
+ | 0.0309 | 2.09 | 8000 | 0.0373 | 0.0 | 0.0 | 0.0 | 0.9859 |
74
+ | 0.0288 | 2.22 | 8500 | 0.0355 | 0.0 | 0.0 | 0.0 | 0.9870 |
75
+ | 0.0288 | 2.35 | 9000 | 0.0359 | 0.0 | 0.0 | 0.0 | 0.9867 |
76
+ | 0.0285 | 2.49 | 9500 | 0.0369 | 0.0 | 0.0 | 0.0 | 0.9872 |
77
+ | 0.0307 | 2.62 | 10000 | 0.0322 | 0.0 | 0.0 | 0.0 | 0.9880 |
78
+ | 0.028 | 2.75 | 10500 | 0.0307 | 0.0 | 0.0 | 0.0 | 0.9886 |
79
+ | 0.0246 | 2.88 | 11000 | 0.0326 | 0.0 | 0.0 | 0.0 | 0.9881 |
80
+ | 0.0267 | 3.01 | 11500 | 0.0346 | 0.0 | 0.0 | 0.0 | 0.9882 |
81
+ | 0.022 | 3.14 | 12000 | 0.0316 | 0.0 | 0.0 | 0.0 | 0.9889 |
82
+ | 0.0218 | 3.27 | 12500 | 0.0357 | 0.0 | 0.0 | 0.0 | 0.9883 |
83
+ | 0.0217 | 3.4 | 13000 | 0.0363 | 0.0 | 0.0 | 0.0 | 0.9883 |
84
+ | 0.0208 | 3.53 | 13500 | 0.0340 | 0.0 | 0.0 | 0.0 | 0.9894 |
85
+ | 0.0223 | 3.66 | 14000 | 0.0304 | 0.0 | 0.0 | 0.0 | 0.9892 |
86
+ | 0.0232 | 3.79 | 14500 | 0.0319 | 0.0 | 0.0 | 0.0 | 0.9894 |
87
+ | 0.0229 | 3.92 | 15000 | 0.0307 | 0.0 | 0.0 | 0.0 | 0.9901 |
88
+ | 0.0192 | 4.06 | 15500 | 0.0310 | 0.0 | 0.0 | 0.0 | 0.9905 |
89
+ | 0.0178 | 4.19 | 16000 | 0.0345 | 0.0 | 0.0 | 0.0 | 0.9897 |
90
+ | 0.0178 | 4.32 | 16500 | 0.0309 | 0.0 | 0.0 | 0.0 | 0.9902 |
91
+ | 0.0173 | 4.45 | 17000 | 0.0328 | 0.0 | 0.0 | 0.0 | 0.9904 |
92
+ | 0.0176 | 4.58 | 17500 | 0.0316 | 0.0 | 0.0 | 0.0 | 0.9908 |
93
+ | 0.017 | 4.71 | 18000 | 0.0307 | 0.0 | 0.0 | 0.0 | 0.9912 |
94
+ | 0.0163 | 4.84 | 18500 | 0.0329 | 0.0 | 0.0 | 0.0 | 0.9909 |
95
+ | 0.018 | 4.97 | 19000 | 0.0295 | 0.0 | 0.0 | 0.0 | 0.9910 |
96
+ | 0.0143 | 5.1 | 19500 | 0.0367 | 0.0 | 0.0 | 0.0 | 0.9903 |
97
+ | 0.0144 | 5.23 | 20000 | 0.0317 | 0.0 | 0.0 | 0.0 | 0.9915 |
98
+ | 0.0158 | 5.36 | 20500 | 0.0290 | 0.0 | 0.0 | 0.0 | 0.9917 |
99
+ | 0.0143 | 5.49 | 21000 | 0.0315 | 0.0 | 0.0 | 0.0 | 0.9917 |
100
+ | 0.0137 | 5.63 | 21500 | 0.0310 | 0.0 | 0.0 | 0.0 | 0.9913 |
101
+ | 0.0135 | 5.76 | 22000 | 0.0310 | 0.0 | 0.0 | 0.0 | 0.9913 |
102
+ | 0.0128 | 5.89 | 22500 | 0.0290 | 0.0 | 0.0 | 0.0 | 0.9917 |
103
+ | 0.0132 | 6.02 | 23000 | 0.0314 | 0.0 | 0.0 | 0.0 | 0.9921 |
104
+ | 0.0124 | 6.15 | 23500 | 0.0274 | 0.0 | 0.0 | 0.0 | 0.9921 |
105
+ | 0.0114 | 6.28 | 24000 | 0.0300 | 0.0 | 0.0 | 0.0 | 0.9921 |
106
+ | 0.0111 | 6.41 | 24500 | 0.0291 | 0.0 | 0.0 | 0.0 | 0.9922 |
107
+ | 0.0109 | 6.54 | 25000 | 0.0307 | 0.0 | 0.0 | 0.0 | 0.9923 |
108
+ | 0.0117 | 6.67 | 25500 | 0.0328 | 0.0 | 0.0 | 0.0 | 0.9921 |
109
+ | 0.0112 | 6.8 | 26000 | 0.0293 | 0.0 | 0.0 | 0.0 | 0.9924 |
110
+ | 0.012 | 6.93 | 26500 | 0.0300 | 0.0 | 0.0 | 0.0 | 0.9924 |
111
+ | 0.0102 | 7.06 | 27000 | 0.0330 | 0.0 | 0.0 | 0.0 | 0.9921 |
112
+ | 0.0094 | 7.2 | 27500 | 0.0323 | 0.0 | 0.0 | 0.0 | 0.9922 |
113
+ | 0.0091 | 7.33 | 28000 | 0.0309 | 0.0 | 0.0 | 0.0 | 0.9924 |
114
+ | 0.0087 | 7.46 | 28500 | 0.0331 | 0.0 | 0.0 | 0.0 | 0.9920 |
115
+ | 0.0091 | 7.59 | 29000 | 0.0332 | 0.0 | 0.0 | 0.0 | 0.9923 |
116
+ | 0.0095 | 7.72 | 29500 | 0.0298 | 0.0 | 0.0 | 0.0 | 0.9925 |
117
+ | 0.0083 | 7.85 | 30000 | 0.0303 | 0.0 | 0.0 | 0.0 | 0.9929 |
118
+ | 0.0097 | 7.98 | 30500 | 0.0298 | 0.0 | 0.0 | 0.0 | 0.9928 |
119
+ | 0.0069 | 8.11 | 31000 | 0.0319 | 0.0 | 0.0 | 0.0 | 0.9926 |
120
+ | 0.0086 | 8.24 | 31500 | 0.0314 | 0.0 | 0.0 | 0.0 | 0.9929 |
121
+ | 0.0079 | 8.37 | 32000 | 0.0306 | 0.0 | 0.0 | 0.0 | 0.9929 |
122
+ | 0.0065 | 8.5 | 32500 | 0.0317 | 0.0 | 0.0 | 0.0 | 0.9926 |
123
+ | 0.0072 | 8.63 | 33000 | 0.0307 | 0.0 | 0.0 | 0.0 | 0.9927 |
124
+ | 0.0082 | 8.77 | 33500 | 0.0306 | 0.0 | 0.0 | 0.0 | 0.9929 |
125
+ | 0.0086 | 8.9 | 34000 | 0.0312 | 0.0 | 0.0 | 0.0 | 0.9931 |
126
+ | 0.0079 | 9.03 | 34500 | 0.0329 | 0.0 | 0.0 | 0.0 | 0.9929 |
127
+ | 0.0061 | 9.16 | 35000 | 0.0326 | 0.0 | 0.0 | 0.0 | 0.9928 |
128
+ | 0.0074 | 9.29 | 35500 | 0.0315 | 0.0 | 0.0 | 0.0 | 0.9928 |
129
+ | 0.0068 | 9.42 | 36000 | 0.0310 | 0.0 | 0.0 | 0.0 | 0.9931 |
130
+ | 0.0059 | 9.55 | 36500 | 0.0318 | 0.0 | 0.0 | 0.0 | 0.9930 |
131
+ | 0.0064 | 9.68 | 37000 | 0.0307 | 0.0 | 0.0 | 0.0 | 0.9933 |
132
+ | 0.0063 | 9.81 | 37500 | 0.0308 | 0.0 | 0.0 | 0.0 | 0.9930 |
133
+ | 0.0062 | 9.94 | 38000 | 0.0311 | 0.0 | 0.0 | 0.0 | 0.9931 |
134
+ | 0.0058 | 10.07 | 38500 | 0.0314 | 0.0 | 0.0 | 0.0 | 0.9932 |
135
+ | 0.0051 | 10.2 | 39000 | 0.0316 | 0.0 | 0.0 | 0.0 | 0.9933 |
136
+ | 0.0065 | 10.33 | 39500 | 0.0315 | 0.0 | 0.0 | 0.0 | 0.9933 |
137
+ | 0.0059 | 10.47 | 40000 | 0.0314 | 0.0 | 0.0 | 0.0 | 0.9933 |
138
+
139
+
140
+ ### Framework versions
141
+
142
+ - Transformers 4.35.2
143
+ - Pytorch 2.1.0+cu121
144
+ - Datasets 2.15.0
145
+ - Tokenizers 0.15.0
config.json ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "microsoft/layoutlmv3-base",
3
+ "architectures": [
4
+ "LayoutLMv3ForTokenClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "bos_token_id": 0,
8
+ "classifier_dropout": null,
9
+ "coordinate_size": 128,
10
+ "eos_token_id": 2,
11
+ "has_relative_attention_bias": true,
12
+ "has_spatial_attention_bias": true,
13
+ "hidden_act": "gelu",
14
+ "hidden_dropout_prob": 0.1,
15
+ "hidden_size": 768,
16
+ "id2label": {
17
+ "0": 0,
18
+ "1": 1,
19
+ "2": 2,
20
+ "3": 3,
21
+ "4": 4
22
+ },
23
+ "initializer_range": 0.02,
24
+ "input_size": 224,
25
+ "intermediate_size": 3072,
26
+ "label2id": {
27
+ "0": 0,
28
+ "1": 1,
29
+ "2": 2,
30
+ "3": 3,
31
+ "4": 4
32
+ },
33
+ "layer_norm_eps": 1e-05,
34
+ "max_2d_position_embeddings": 1024,
35
+ "max_position_embeddings": 514,
36
+ "max_rel_2d_pos": 256,
37
+ "max_rel_pos": 128,
38
+ "model_type": "layoutlmv3",
39
+ "num_attention_heads": 12,
40
+ "num_channels": 3,
41
+ "num_hidden_layers": 12,
42
+ "pad_token_id": 1,
43
+ "patch_size": 16,
44
+ "rel_2d_pos_bins": 64,
45
+ "rel_pos_bins": 32,
46
+ "second_input_size": 112,
47
+ "shape_size": 128,
48
+ "text_embed": true,
49
+ "torch_dtype": "float32",
50
+ "transformers_version": "4.35.2",
51
+ "type_vocab_size": 1,
52
+ "visual_embed": true,
53
+ "vocab_size": 50265
54
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9e985ee2af99e37340354887f0cfdfe5c093cfd95bb7fcb61f43a53df44c985
3
+ size 501349380
preprocessor_config.json ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "apply_ocr": false,
3
+ "do_normalize": true,
4
+ "do_rescale": true,
5
+ "do_resize": true,
6
+ "feature_extractor_type": "LayoutLMv3FeatureExtractor",
7
+ "image_mean": [
8
+ 0.5,
9
+ 0.5,
10
+ 0.5
11
+ ],
12
+ "image_processor_type": "LayoutLMv3ImageProcessor",
13
+ "image_std": [
14
+ 0.5,
15
+ 0.5,
16
+ 0.5
17
+ ],
18
+ "ocr_lang": null,
19
+ "processor_class": "LayoutLMv3Processor",
20
+ "resample": 2,
21
+ "rescale_factor": 0.00392156862745098,
22
+ "size": {
23
+ "height": 224,
24
+ "width": 224
25
+ },
26
+ "tesseract_config": ""
27
+ }
runs/Dec20_05-48-01_a4b5ac2ed673/events.out.tfevents.1703051319.a4b5ac2ed673.27874.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f847bc43cce4035cb6a6b32da629810be82b1b5a90dad8813327c546a0bb4e87
3
+ size 4671
runs/Dec20_06-25-15_a4b5ac2ed673/events.out.tfevents.1703053523.a4b5ac2ed673.36677.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1834ff58d9fb12bd495735a8d07e7be80ef37230b4da47bcb2f19fa51fdd525b
3
+ size 4671
runs/Dec20_06-27-05_a4b5ac2ed673/events.out.tfevents.1703053632.a4b5ac2ed673.36677.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cf2bac580949ebb8faeead0a1b8607279e2c47113b09db2d0c4356ec3496c54
3
+ size 4672
runs/Dec20_06-28-08_a4b5ac2ed673/events.out.tfevents.1703053693.a4b5ac2ed673.36677.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33875fb272214d60e17f7b98f7cfd69574924c368d23bba3e0cfe1b7bab17fc7
3
+ size 4671
runs/Dec20_06-29-31_a4b5ac2ed673/events.out.tfevents.1703053777.a4b5ac2ed673.36677.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf309c336142ecafe927ac28a3cbc353a217426f2a09a469c71c2c913953d609
3
+ size 4671
runs/Dec20_06-30-09_a4b5ac2ed673/events.out.tfevents.1703053812.a4b5ac2ed673.36677.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:819008f6d422cb9440a5a76120157b41f515fb0a2d923384424f9f8f93b308c5
3
+ size 4671
runs/Dec20_06-31-02_a4b5ac2ed673/events.out.tfevents.1703053868.a4b5ac2ed673.36677.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d70942ada6ab884eba5152d4344e522da2eb11a6a27dc7d39a8681d8d400469b
3
+ size 9254
runs/Dec20_06-31-36_a4b5ac2ed673/events.out.tfevents.1703053899.a4b5ac2ed673.36677.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fc29a64806863e39d4bba3b04eb9fefd9504b2352e40bd77606e9967c9344c8
3
+ size 4673
runs/Dec20_06-31-36_a4b5ac2ed673/events.out.tfevents.1703053958.a4b5ac2ed673.36677.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5afdba14ab663ad4f2381e2069f1ff33a2d5e610ef619670faffa202a47b9981
3
+ size 6552
runs/Dec20_06-35-04_a4b5ac2ed673/events.out.tfevents.1703054110.a4b5ac2ed673.36677.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9839f23692c18b1a3288f8d64e975674f80476ab179a71681dfcd3265334b824
3
+ size 17606
runs/Dec20_07-19-58_a4b5ac2ed673/events.out.tfevents.1703056806.a4b5ac2ed673.36677.9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d452ec81fce6a4d3a936164e968786c76a18f3ce6a18e5e18f037ad0c646367f
3
+ size 55993
special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": true,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": true,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": true,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": true,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": true,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": true,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "<unk>",
46
+ "lstrip": false,
47
+ "normalized": true,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": true,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<s>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "<pad>",
14
+ "lstrip": false,
15
+ "normalized": true,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "</s>",
22
+ "lstrip": false,
23
+ "normalized": true,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "3": {
29
+ "content": "<unk>",
30
+ "lstrip": false,
31
+ "normalized": true,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "50264": {
37
+ "content": "<mask>",
38
+ "lstrip": true,
39
+ "normalized": true,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ }
44
+ },
45
+ "apply_ocr": false,
46
+ "bos_token": "<s>",
47
+ "clean_up_tokenization_spaces": true,
48
+ "cls_token": "<s>",
49
+ "cls_token_box": [
50
+ 0,
51
+ 0,
52
+ 0,
53
+ 0
54
+ ],
55
+ "eos_token": "</s>",
56
+ "errors": "replace",
57
+ "mask_token": "<mask>",
58
+ "model_max_length": 512,
59
+ "only_label_first_subword": true,
60
+ "pad_token": "<pad>",
61
+ "pad_token_box": [
62
+ 0,
63
+ 0,
64
+ 0,
65
+ 0
66
+ ],
67
+ "pad_token_label": -100,
68
+ "processor_class": "LayoutLMv3Processor",
69
+ "sep_token": "</s>",
70
+ "sep_token_box": [
71
+ 0,
72
+ 0,
73
+ 0,
74
+ 0
75
+ ],
76
+ "tokenizer_class": "LayoutLMv3Tokenizer",
77
+ "trim_offsets": true,
78
+ "unk_token": "<unk>"
79
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e3ac4b85ac2371b32649634573c7da70ef1a1e617b49da1ab6933a697031728
3
+ size 4536
vocab.json ADDED
The diff for this file is too large to render. See raw diff