Update citation info
Browse files
README.md
CHANGED
@@ -161,7 +161,7 @@ Training happened in early March 2023 and took about two weeks.
|
|
161 |
|
162 |
## Evaluation
|
163 |
|
164 |
-
*Paper coming soon
|
165 |
|
166 |
See the [OpenLLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) for early results.
|
167 |
|
@@ -199,7 +199,28 @@ Falcon-7B was trained a custom distributed training codebase, Gigatron. It uses
|
|
199 |
|
200 |
## Citation
|
201 |
|
202 |
-
*Paper coming soon* π.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
203 |
|
204 |
## License
|
205 |
|
|
|
161 |
|
162 |
## Evaluation
|
163 |
|
164 |
+
*Paper coming soon*.
|
165 |
|
166 |
See the [OpenLLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) for early results.
|
167 |
|
|
|
199 |
|
200 |
## Citation
|
201 |
|
202 |
+
*Paper coming soon* π. In the meanwhile, you can use the following information to cite:
|
203 |
+
```
|
204 |
+
@article{falcon40b,
|
205 |
+
title={{Falcon-40B}: an open large language model with state-of-the-art performance},
|
206 |
+
author={Almazrouei, Ebtesam and Alobeidli, Hamza and Alshamsi, Abdulaziz and Cappelli, Alessandro and Cojocaru, Ruxandra and Debbah, Merouane and Goffinet, Etienne and Heslow, Daniel and Launay, Julien and Malartic, Quentin and Noune, Badreddine and Pannier, Baptiste and Penedo, Guilherme},
|
207 |
+
year={2023}
|
208 |
+
}
|
209 |
+
```
|
210 |
+
|
211 |
+
To learn more about the pretraining dataset, see the π [RefinedWeb paper](https://arxiv.org/abs/2306.01116).
|
212 |
+
|
213 |
+
```
|
214 |
+
@article{refinedweb,
|
215 |
+
title={The {R}efined{W}eb dataset for {F}alcon {LLM}: outperforming curated corpora with web data, and web data only},
|
216 |
+
author={Guilherme Penedo and Quentin Malartic and Daniel Hesslow and Ruxandra Cojocaru and Alessandro Cappelli and Hamza Alobeidli and Baptiste Pannier and Ebtesam Almazrouei and Julien Launay},
|
217 |
+
journal={arXiv preprint arXiv:2306.01116},
|
218 |
+
eprint={2306.01116},
|
219 |
+
eprinttype = {arXiv},
|
220 |
+
url={https://arxiv.org/abs/2306.01116},
|
221 |
+
year={2023}
|
222 |
+
}
|
223 |
+
```
|
224 |
|
225 |
## License
|
226 |
|