RMWeerasinghe
/

flan-t5-base-finetuned-QLoRA

Generated from Trainer

Model card Files Files and versions Community

RMWeerasinghe commited on Feb 19

Commit

35d58b0

•

1 Parent(s): c7159ae

Training complete

Files changed (1) hide show

README.md +15 -15

README.md CHANGED Viewed

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on the cnn_dailymail dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.5612
-- Rouge1: 0.2459
-- Rouge2: 0.1153
-- Rougel: 0.1998
-- Rougelsum: 0.2294
 ## Model description
@@ -56,16 +56,16 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
 |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|
-| 15.0637       | 1.0   | 125  | 14.5380         | 0.2315 | 0.0949 | 0.1776 | 0.2084    |
-| 11.8916       | 2.0   | 250  | 11.5849         | 0.2319 | 0.0957 | 0.1818 | 0.2077    |
-| 7.8325        | 3.0   | 375  | 5.8491          | 0.2294 | 0.0978 | 0.1839 | 0.2098    |
-| 3.6167        | 4.0   | 500  | 2.9519          | 0.2345 | 0.1096 | 0.1915 | 0.2195    |
-| 3.0365        | 5.0   | 625  | 2.3695          | 0.2391 | 0.1132 | 0.1964 | 0.2228    |
-| 2.7862        | 6.0   | 750  | 1.9609          | 0.2428 | 0.1163 | 0.1981 | 0.2258    |
-| 2.5261        | 7.0   | 875  | 1.7701          | 0.2462 | 0.1137 | 0.1979 | 0.2292    |
-| 2.3319        | 8.0   | 1000 | 1.6463          | 0.2459 | 0.1142 | 0.1995 | 0.2294    |
-| 2.355         | 9.0   | 1125 | 1.5820          | 0.2442 | 0.114  | 0.1998 | 0.2279    |
-| 2.323         | 10.0  | 1250 | 1.5612          | 0.2459 | 0.1153 | 0.1998 | 0.2294    |
 ### Framework versions

 This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on the cnn_dailymail dataset.
 It achieves the following results on the evaluation set:
+- Loss: 1.0780
+- Rouge1: 0.2435
+- Rouge2: 0.1079
+- Rougel: 0.1991
+- Rougelsum: 0.2302
 ## Model description
 | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
 |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|
+| 12.7942       | 1.0   | 250  | 10.7766         | 0.2346 | 0.1022 | 0.1834 | 0.2154    |
+| 3.0774        | 2.0   | 500  | 2.5061          | 0.2351 | 0.1094 | 0.197  | 0.2204    |
+| 2.1947        | 3.0   | 750  | 1.4702          | 0.2403 | 0.1104 | 0.1997 | 0.2261    |
+| 1.7687        | 4.0   | 1000 | 1.2326          | 0.247  | 0.1148 | 0.2024 | 0.2307    |
+| 1.4731        | 5.0   | 1250 | 1.1516          | 0.2538 | 0.1203 | 0.2074 | 0.2381    |
+| 1.4802        | 6.0   | 1500 | 1.1120          | 0.2432 | 0.1102 | 0.1993 | 0.2271    |
+| 1.3568        | 7.0   | 1750 | 1.0945          | 0.2427 | 0.1089 | 0.1991 | 0.2279    |
+| 1.4054        | 8.0   | 2000 | 1.0843          | 0.2428 | 0.1076 | 0.1993 | 0.2293    |
+| 1.3151        | 9.0   | 2250 | 1.0795          | 0.2432 | 0.1076 | 0.1991 | 0.2299    |
+| 1.2669        | 10.0  | 2500 | 1.0780          | 0.2435 | 0.1079 | 0.1991 | 0.2302    |
 ### Framework versions