Update README.md

README.md

@@ -35,20 +35,24 @@ widget:
 <details>
 <summary>Click to expand</summary>
 
-- [Model Description](#model-description)
-- [Intended Uses and Limitations](#intended-uses-and-limitations)
-- [How to Use](#how-to-use)
+- [Model description](#model-description)
+- [Intended uses and limitations](#intended-use)
+- [How to use](#how-to-use)
+- [Limitations and bias](#limitations-and-bias)
 - [Training](#training)
-  - [Training Data](#training-data)
-  - [Training Procedure](#training-procedure)
+  - [Training data](#training-data)
+  - [Training procedure](#training-procedure)
 - [Evaluation](#evaluation)
-   - [CLUB Benchmark](#club-benchmark)
-   - [Evaluation Results](#evaluation-results)
-- [Licensing Information](#licensing-information)
-- [Citation Information](#citation-information)
-- [Funding](#funding)
-- [Contributions](#contributions)
-- [Disclaimer](#disclaimer)
+   - [CLUB benchmark](#club-benchmark)
+   - [Evaluation results](#evaluation-results)
+- [Additional information](#additional-information)
+  - [Author](#author)
+  - [Contact information](#contact-information)
+  - [Copyright](#copyright)
+  - [Licensing information](#licensing-information)
+  - [Funding](#funding)
+  - [Citing information](#citing-information)
+  - [Disclaimer](#disclaimer)
 
 </details>
 
@@ -58,12 +62,12 @@ The **roberta-large-ca-v2** is a transformer-based masked language model for the
 It is based on the [RoBERTA](https://github.com/pytorch/fairseq/tree/master/examples/roberta) large model 
 and has been trained on a medium-size corpus collected from publicly available corpora and crawlers.
 
-## Intended Uses and Limitations
+## Intended uses and limitations
 
 **roberta-large-ca-v2** model is ready-to-use only for masked language modeling to perform the Fill Mask task (try the inference API or read the next section).
 However, it is intended to be fine-tuned on non-generative downstream tasks such as Question Answering, Text Classification, or Named Entity Recognition.
 
-## How to Use
+## How to use
 
 Here is how to use this model:
 
@@ -80,6 +84,9 @@ res_hf = pipeline(text)
 pprint([r['token_str'] for r in res_hf])
 ```
 
+## Limitations and bias
+At the time of submission, no measures have been taken to estimate the bias embedded in the model. However, we are well aware that our models may be biased since the corpora have been collected using crawling techniques on multiple web sources. We intend to conduct research in these areas in the future, and if completed, this model card will be updated.
+
 ## Training
 
 ### Training data
@@ -104,7 +111,7 @@ The training corpus consists of several corpora gathered from web crawling and p
 | Vilaweb                 | 0.06       |
 | Tweets                  | 0.02       |
 
-### Training Procedure
+### Training procedure
 
 The training corpus has been tokenized using a byte version of [Byte-Pair Encoding (BPE)](https://github.com/openai/gpt-2)
 used in the original [RoBERTA](https://github.com/pytorch/fairseq/tree/master/examples/roberta) model with a vocabulary size of 50,262 tokens. 
@@ -115,7 +122,7 @@ The training lasted a total of 96 hours with 32 NVIDIA V100 GPUs of 16GB DDRAM.
 
 ## Evaluation
 
-### CLUB Benchmark
+### CLUB benchmark
 
 The BERTa-large model has been fine-tuned on the downstream tasks of the Catalan Language Understanding Evaluation benchmark (CLUB),
 that has been created along with the model.
@@ -168,7 +175,7 @@ Here are the train/dev/test splits of the datasets:
 | QA (ViquiQuAD) | 14,239  | 11,255  | 1,492  | 1,429 |
 | QA (CatalanQA) | 21,427  | 17,135  | 2,157  | 2,135 |
 
-### Evaluation Results
+### Evaluation results
 
 | Task        | NER (F1)      | POS (F1)   | STS-ca (Comb)   | TeCla (Acc.) | TEca (Acc.) | VilaQuAD (F1/EM)| ViquiQuAD (F1/EM) | CatalanQA (F1/EM) | XQuAD-ca <sup>1</sup> (F1/EM) | 
 | ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|:----|
@@ -180,11 +187,24 @@ Here are the train/dev/test splits of the datasets:
 
 <sup>1</sup> : Trained on CatalanQA, tested on XQuAD-ca.
 
-## Licensing Information
+## Additional information
+
+### Author
+Text Mining Unit (TeMU) at the Barcelona Supercomputing Center (bsc-temu@bsc.es)
+
+### Contact information
+For further information, send an email to aina@bsc.es
 
+### Copyright
+Copyright (c) 2022 Text Mining Unit at Barcelona Supercomputing Center 
+
+### Licensing information
 [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0)
 
-## Citation Information 
+### Funding
+This work was funded by the [Departament de la Vicepresidència i de Polítiques Digitals i Territori de la Generalitat de Catalunya](https://politiquesdigitals.gencat.cat/ca/inici/index.html#googtrans(ca|en) within the framework of [Projecte AINA](https://politiquesdigitals.gencat.cat/ca/economia/catalonia-ai/aina).
+
+### Citation information 
 
 If you use any of these resources (datasets or models) in your work, please cite our latest paper:
 ```bibtex
@@ -209,16 +229,7 @@ If you use any of these resources (datasets or models) in your work, please cite
 }
 ```
 
-## Funding
-
-This work was funded by the [Departament de la Vicepresidència i de Polítiques Digitals i Territori de la Generalitat de Catalunya](https://politiquesdigitals.gencat.cat/ca/inici/index.html#googtrans(ca|en) within the framework of [Projecte AINA](https://politiquesdigitals.gencat.cat/ca/economia/catalonia-ai/aina).
-
-## Contributions
-
-[N/A]
-
-
-## Disclaimer
+### Disclaimer
 
 <details>
 <summary>Click to expand</summary>