israelcamp
commited on
Commit
•
cdc8aa3
1
Parent(s):
52be592
Update README.md
Browse files
README.md
CHANGED
@@ -10,9 +10,11 @@ language:
|
|
10 |
|
11 |
# DeBERTinha XSmall (aka "debertinha-ptbr-xsmall")
|
12 |
|
13 |
-
##
|
14 |
-
|
15 |
-
|
|
|
|
|
16 |
|
17 |
## Introduction
|
18 |
|
|
|
10 |
|
11 |
# DeBERTinha XSmall (aka "debertinha-ptbr-xsmall")
|
12 |
|
13 |
+
## NOTE
|
14 |
+
We have received feedback of people getting poor results on unbalanced datasets. A more robust training script, like scaling
|
15 |
+
the loss and adding weight decay (1e-3 to 1e-5) seems to fix it.
|
16 |
+
If you have any problems using the model, please contact us.
|
17 |
+
Thanks!
|
18 |
|
19 |
## Introduction
|
20 |
|