VictorYeste commited on
Commit
b6994d6
1 Parent(s): 7a79a25

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md CHANGED
@@ -40,4 +40,29 @@ This returns the following:
40
  ```
41
  [[{'label': 'constrained', 'score': 0.7598766088485718},
42
  {'label': 'attained', 'score': 0.24012333154678345}]]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
43
  ```
 
40
  ```
41
  [[{'label': 'constrained', 'score': 0.7598766088485718},
42
  {'label': 'attained', 'score': 0.24012333154678345}]]
43
+ ```
44
+
45
+ # Performance
46
+
47
+ This work proposes a system to resolve the challenge sub-tasks related to human values detection. Our approach uses cascade DeBERTa models, where the first detects the presence of each human value, and the second detects if the sentence attains or constrains the present human values in each sentence. The latter approach improves the effectiveness of the baseline at the test dataset by 4 on sub-task 1 and by 1 on sub-task 2. These models were trained on a subset of 44,758 sentences in English, validated on a subset of 14,904 sentences, and tested on a separate subset of 14,569 sentences.
48
+
49
+ This model has got the third place in the subtask 1 of Human Value Detection at CLEF 2024.
50
+
51
+ # Limitations and bias
52
+
53
+ At the time of submission, no measures have been taken to estimate the bias embedded in the model, so it may not be safe for use in production.
54
+
55
+ # License
56
+
57
+ The model is released under open license CC BY 4.0, available at https://creativecommons.org/licenses/by/4.0/legalcode.
58
+
59
+ # BibTeX entry and citation information
60
+
61
+ ```
62
+ @inproceedings{yeste2024philo,
63
+ title={Philo of Alexandria at touch{\'e}: a cascade model approach to human value detection},
64
+ author={Yeste, V{\'\i}ctor and Coll-Ardanuy, M and Rosso, Paolo},
65
+ booktitle={Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024). CEUR Workshop Proceedings, CEUR-WS. org},
66
+ year={2024}
67
+ }
68
  ```