README.md

metadata

license: llama2
datasets:
  - YeungNLP/firefly-pretrain-dataset
language:
  - zh
  - en

Model Details

• Developed by: zyh3826
• Backbone Model: llama-2-13B
• Library: HuggingFace Transformers

全参数继续预训练中文llama2-13B，取76000步ckpt测试，其他细节待补充