| license: llama2 | |
| datasets: | |
| - YeungNLP/firefly-pretrain-dataset | |
| language: | |
| - zh | |
| - en | |
| # Model Details | |
| + Developed by: zyh3826 | |
| + Backbone Model: llama-2-13B | |
| + Library: HuggingFace Transformers | |
| 全参数继续预训练中文llama2-13B，取76000步ckpt测试，其他细节待补充 |
| license: llama2 | |
| datasets: | |
| - YeungNLP/firefly-pretrain-dataset | |
| language: | |
| - zh | |
| - en | |
| # Model Details | |
| + Developed by: zyh3826 | |
| + Backbone Model: llama-2-13B | |
| + Library: HuggingFace Transformers | |
| 全参数继续预训练中文llama2-13B，取76000步ckpt测试，其他细节待补充 |