kaytoo2022/t5_technical_qa_082824_v3

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

• Train Loss: 0.4442
• Validation Loss: 0.4904
• Epoch: 11

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
• training_precision: float32

Training results

Train Loss	Validation Loss	Epoch
0.6190	0.5770	0
0.5755	0.5580	1
0.5471	0.5431	2
0.5271	0.5338	3
0.5084	0.5258	4
0.4830	0.5188	5
0.4895	0.5123	6
0.4716	0.5071	7
0.4724	0.5029	8
0.4452	0.5003	9
0.4408	0.4967	10
0.4442	0.4904	11

Framework versions

• Transformers 4.42.4
• TensorFlow 2.17.0
• Datasets 2.21.0
• Tokenizers 0.19.1