End of training

README.md

@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the https://www.kaggle.com/datasets/skywardai/network-vulnerability dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2520
+- Loss: 0.1812
 
 ## Model description
 
@@ -39,7 +39,7 @@ The following hyperparameters were used during training:
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - num_epochs: 3
 
@@ -47,14 +47,14 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.2417        | 1.0   | 63   | 0.2539          |
-| 0.1808        | 2.0   | 126  | 0.2488          |
-| 0.1045        | 3.0   | 189  | 0.2520          |
+| 0.1845        | 1.0   | 63   | 0.1808          |
+| 0.1793        | 2.0   | 126  | 0.1811          |
+| 0.2158        | 3.0   | 189  | 0.1812          |
 
 
 ### Framework versions
 
-- Transformers 4.45.1
-- Pytorch 2.4.0
-- Datasets 3.0.1
-- Tokenizers 0.20.0
+- Transformers 4.46.1
+- Pytorch 2.2.2
+- Datasets 3.1.0
+- Tokenizers 0.20.1

config.json

@@ -20,7 +20,7 @@
   "position_embedding_type": "absolute",
   "problem_type": "single_label_classification",
   "torch_dtype": "float32",
-  "transformers_version": "4.45.1",
+  "transformers_version": "4.46.1",
   "type_vocab_size": 2,
   "use_cache": true,
   "vocab_size": 30522

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e84089372be791912ba781d7b0f22a61d52260d1e9a21d40c27140579bcbf8db
+oid sha256:c8bd3d3aac6c785b385cc9329fe46a80a87330e67e5706a6b35ab961308d81d7
 size 437958648

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:640ee8ba7cbe4f75950f1fbcd6b4538d298a1f332239cecdd0f0b40747686c18
+oid sha256:3019045d8ca038d50d383ef7e0f0647a7e48b0889da2f3276f954da053279565
 size 5240