lewtun HF staff commited on
Commit
4d94735
1 Parent(s): d2fde4c

Add evaluation results on the 3.0.0 config of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@nbroad

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-cnn_dailymail-8f63e3f3-11895593).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -7,6 +7,42 @@ datasets:
7
  - cnn_dailymail
8
  - xsum
9
  thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  ### Usage
 
7
  - cnn_dailymail
8
  - xsum
9
  thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
10
+ model-index:
11
+ - name: sshleifer/distilbart-cnn-6-6
12
+ results:
13
+ - task:
14
+ type: summarization
15
+ name: Summarization
16
+ dataset:
17
+ name: cnn_dailymail
18
+ type: cnn_dailymail
19
+ config: 3.0.0
20
+ split: test
21
+ metrics:
22
+ - name: ROUGE-1
23
+ type: rouge
24
+ value: 42.7007
25
+ verified: true
26
+ - name: ROUGE-2
27
+ type: rouge
28
+ value: 20.1823
29
+ verified: true
30
+ - name: ROUGE-L
31
+ type: rouge
32
+ value: 29.7085
33
+ verified: true
34
+ - name: ROUGE-LSUM
35
+ type: rouge
36
+ value: 39.6714
37
+ verified: true
38
+ - name: loss
39
+ type: loss
40
+ value: 3.0600528717041016
41
+ verified: true
42
+ - name: gen_len
43
+ type: gen_len
44
+ value: 67.5926
45
+ verified: true
46
  ---
47
 
48
  ### Usage