File size: 1,199 Bytes
1e69949
a00413c
 
 
 
 
 
 
de05e65
 
 
 
064dde9
d400178
a00413c
de05e65
 
 
 
 
6a22d85
 
de05e65
5c9100d
de05e65
159f598
 
6a22d85
 
 
d305e24
de05e65
5c9100d
d362496
d305e24
 
 
de05e65
5c9100d
d362496
7371bea
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
---
language: 
- en
tags:
- text-classification
metrics:
- accuracy
datasets:
- snli-1.0
- multi-nli-1.0
- nli-fever
- anli-v1.0
widget:
- text: "British mountaineer Alison Hargreaves becomes the first woman to climb Mount Everest alone and without oxygen tanks. [SEP] Alison is a female."

---

## deberta-v3-large-snli_mnli_fever_anli_R1_R2_R3-nli

#### Datasets
Based on microsoft/deberta-v3-large, this model was trained on the snli-v1.0, multi-nli-1.0, nli-fever and anli-1.0-r1/anli-1.0-r2/anli-1.0-r3 datasets, with the training weights of 1,1,1,10,20,10 respectively.  
The training codes are mostly referenced from: https://github.com/facebookresearch/anli


#### Hyperparameters
learning_rate: 1e-5  
max_length: 156  
batch_size: 16  
warmup_ratio: 0.1   
weight_decay: 0.0   
num_epochs: 2


#### Dev results
snli-v1.0 | multi-nli-1.0-m | multi-nli-1.0-mm | anli-1.0-r1 | anli-1.0-r2 | anli-1.0-r3
----------|-----------------|------------------|-------------|-------------|------------
0.938 | 0.914 | 0.912 | 0.796 | 0.627 | 0.610


#### Test results
snli-v1.0 | anli-1.0-r1 | anli-1.0-r2 | anli-1.0-r3
-----------|-------------|-------------|------------
0.929 | 0.775 | 0.636 | 0.612