israelcamp commited on
Commit
cdc8aa3
1 Parent(s): 52be592

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -10,9 +10,11 @@ language:
10
 
11
  # DeBERTinha XSmall (aka "debertinha-ptbr-xsmall")
12
 
13
- ## WARNING
14
- Please use with care, we are investigating possible bugs during training.
15
- Check back here soon. Thanks =)
 
 
16
 
17
  ## Introduction
18
 
 
10
 
11
  # DeBERTinha XSmall (aka "debertinha-ptbr-xsmall")
12
 
13
+ ## NOTE
14
+ We have received feedback of people getting poor results on unbalanced datasets. A more robust training script, like scaling
15
+ the loss and adding weight decay (1e-3 to 1e-5) seems to fix it.
16
+ If you have any problems using the model, please contact us.
17
+ Thanks!
18
 
19
  ## Introduction
20