Hugging Face's logo

Sybghat
/
FAQs_DistillBERT

Question Answering
Transformers
TensorBoard
Safetensors
distilbert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
Sybghat commited on
Commit
e04e154
•
1 Parent(s): 4a4601e

Model save

Browse files
Files changed (6) hide show
  1. README.md +3 -54
  2. model.safetensors +1 -1
  3. runs/Mar21_06-57-46_50cb1a920b5a/events.out.tfevents.1711004275.50cb1a920b5a.1441.2 +3 -0
  4. runs/Mar21_06-58-02_50cb1a920b5a/events.out.tfevents.1711004286.50cb1a920b5a.1441.3 +3 -0
  5. runs/Mar21_07-13-04_50cb1a920b5a/events.out.tfevents.1711005195.50cb1a920b5a.1441.4 +3 -0
  6. training_args.bin +1 -1
README.md CHANGED
@@ -13,9 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # FAQs_DistillBERT
15
 
16
- This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on the None dataset.
17
- It achieves the following results on the evaluation set:
18
- - Loss: 0.1075
19
 
20
  ## Model description
21
 
@@ -40,62 +38,13 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 50
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | No log | 1.0 | 194 | 0.1131 |
50
- | No log | 2.0 | 388 | 0.1129 |
51
- | 0.0986 | 3.0 | 582 | 0.1211 |
52
- | 0.0986 | 4.0 | 776 | 0.1023 |
53
- | 0.0986 | 5.0 | 970 | 0.1023 |
54
- | 0.0589 | 6.0 | 1164 | 0.1051 |
55
- | 0.0589 | 7.0 | 1358 | 0.1044 |
56
- | 0.0327 | 8.0 | 1552 | 0.1100 |
57
- | 0.0327 | 9.0 | 1746 | 0.0981 |
58
- | 0.0327 | 10.0 | 1940 | 0.1029 |
59
- | 0.0209 | 11.0 | 2134 | 0.0960 |
60
- | 0.0209 | 12.0 | 2328 | 0.0969 |
61
- | 0.0126 | 13.0 | 2522 | 0.1022 |
62
- | 0.0126 | 14.0 | 2716 | 0.0985 |
63
- | 0.0126 | 15.0 | 2910 | 0.1139 |
64
- | 0.0095 | 16.0 | 3104 | 0.1139 |
65
- | 0.0095 | 17.0 | 3298 | 0.1025 |
66
- | 0.0095 | 18.0 | 3492 | 0.0986 |
67
- | 0.0062 | 19.0 | 3686 | 0.0962 |
68
- | 0.0062 | 20.0 | 3880 | 0.0949 |
69
- | 0.0029 | 21.0 | 4074 | 0.1059 |
70
- | 0.0029 | 22.0 | 4268 | 0.1098 |
71
- | 0.0029 | 23.0 | 4462 | 0.1088 |
72
- | 0.0035 | 24.0 | 4656 | 0.1047 |
73
- | 0.0035 | 25.0 | 4850 | 0.1138 |
74
- | 0.003 | 26.0 | 5044 | 0.1101 |
75
- | 0.003 | 27.0 | 5238 | 0.1064 |
76
- | 0.003 | 28.0 | 5432 | 0.0978 |
77
- | 0.0028 | 29.0 | 5626 | 0.1100 |
78
- | 0.0028 | 30.0 | 5820 | 0.1007 |
79
- | 0.0027 | 31.0 | 6014 | 0.1038 |
80
- | 0.0027 | 32.0 | 6208 | 0.0982 |
81
- | 0.0027 | 33.0 | 6402 | 0.1057 |
82
- | 0.0044 | 34.0 | 6596 | 0.1100 |
83
- | 0.0044 | 35.0 | 6790 | 0.0932 |
84
- | 0.0044 | 36.0 | 6984 | 0.0961 |
85
- | 0.0027 | 37.0 | 7178 | 0.0973 |
86
- | 0.0027 | 38.0 | 7372 | 0.0968 |
87
- | 0.0018 | 39.0 | 7566 | 0.0942 |
88
- | 0.0018 | 40.0 | 7760 | 0.1006 |
89
- | 0.0018 | 41.0 | 7954 | 0.1028 |
90
- | 0.0025 | 42.0 | 8148 | 0.1023 |
91
- | 0.0025 | 43.0 | 8342 | 0.1006 |
92
- | 0.0018 | 44.0 | 8536 | 0.1051 |
93
- | 0.0018 | 45.0 | 8730 | 0.1056 |
94
- | 0.0018 | 46.0 | 8924 | 0.1072 |
95
- | 0.0019 | 47.0 | 9118 | 0.1075 |
96
- | 0.0019 | 48.0 | 9312 | 0.1074 |
97
- | 0.0017 | 49.0 | 9506 | 0.1074 |
98
- | 0.0017 | 50.0 | 9700 | 0.1075 |
99
 
100
 
101
  ### Framework versions
 
13
 
14
  # FAQs_DistillBERT
15
 
16
+ This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
 
 
17
 
18
  ## Model description
19
 
 
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - num_epochs: 1
42
 
43
  ### Training results
44
 
45
  | Training Loss | Epoch | Step | Validation Loss |
46
  |:-------------:|:-----:|:----:|:---------------:|
47
+ | No log | 1.0 | 250 | 3.1395 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
 
49
 
50
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f4e0541a522e05e0792de30c572577d42727381811584c226f62a0c057eb49f3
3
  size 265470032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c3225a3914f0eeba6a8768b809b943cb04d65087c4392b71e1e4753e8cf1244
3
  size 265470032
runs/Mar21_06-57-46_50cb1a920b5a/events.out.tfevents.1711004275.50cb1a920b5a.1441.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fea24dd08abeda6f7071e6c8d423502b6b3e5197c52436c365c8202d4f384917
3
+ size 4454
runs/Mar21_06-58-02_50cb1a920b5a/events.out.tfevents.1711004286.50cb1a920b5a.1441.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d73848221e14c4a2eb56d5882f359bed3422757939e0585f100929763d6e1a34
3
+ size 5079
runs/Mar21_07-13-04_50cb1a920b5a/events.out.tfevents.1711005195.50cb1a920b5a.1441.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fbbf50b3610ea68df20b667d7f6e9d133d8b49e8ebd47d79e0fc03f0b9cc2b9
3
+ size 5079
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9a2cdf73778a941cdf5dc34ccbdddb9ed6213e210f00d9edf6b1224511e26b6c
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b399224c4c5d4c65f522103c5a6c13f8b999fadc3e3c78978e8537fa2e86f52
3
  size 4920