VictorYeste
commited on
Commit
•
b6994d6
1
Parent(s):
7a79a25
Update README.md
Browse files
README.md
CHANGED
@@ -40,4 +40,29 @@ This returns the following:
|
|
40 |
```
|
41 |
[[{'label': 'constrained', 'score': 0.7598766088485718},
|
42 |
{'label': 'attained', 'score': 0.24012333154678345}]]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
43 |
```
|
|
|
40 |
```
|
41 |
[[{'label': 'constrained', 'score': 0.7598766088485718},
|
42 |
{'label': 'attained', 'score': 0.24012333154678345}]]
|
43 |
+
```
|
44 |
+
|
45 |
+
# Performance
|
46 |
+
|
47 |
+
This work proposes a system to resolve the challenge sub-tasks related to human values detection. Our approach uses cascade DeBERTa models, where the first detects the presence of each human value, and the second detects if the sentence attains or constrains the present human values in each sentence. The latter approach improves the effectiveness of the baseline at the test dataset by 4 on sub-task 1 and by 1 on sub-task 2. These models were trained on a subset of 44,758 sentences in English, validated on a subset of 14,904 sentences, and tested on a separate subset of 14,569 sentences.
|
48 |
+
|
49 |
+
This model has got the third place in the subtask 1 of Human Value Detection at CLEF 2024.
|
50 |
+
|
51 |
+
# Limitations and bias
|
52 |
+
|
53 |
+
At the time of submission, no measures have been taken to estimate the bias embedded in the model, so it may not be safe for use in production.
|
54 |
+
|
55 |
+
# License
|
56 |
+
|
57 |
+
The model is released under open license CC BY 4.0, available at https://creativecommons.org/licenses/by/4.0/legalcode.
|
58 |
+
|
59 |
+
# BibTeX entry and citation information
|
60 |
+
|
61 |
+
```
|
62 |
+
@inproceedings{yeste2024philo,
|
63 |
+
title={Philo of Alexandria at touch{\'e}: a cascade model approach to human value detection},
|
64 |
+
author={Yeste, V{\'\i}ctor and Coll-Ardanuy, M and Rosso, Paolo},
|
65 |
+
booktitle={Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024). CEUR Workshop Proceedings, CEUR-WS. org},
|
66 |
+
year={2024}
|
67 |
+
}
|
68 |
```
|