README.md

metadata

language:
  - en
tags:
  - pytorch
  - text-generation
  - causal-lm
  - rwkv
license: apache-2.0
datasets:
  - the_pile

RWKV-4 Novel Models

Model Description

These are RWKV-4-Pile models finetuned on novels.

Currently I am doing it for Chn novels. More languages to come.

Use https://github.com/BlinkDL/ChatRWKV to run them.

See https://github.com/BlinkDL/RWKV-LM for details on the RWKV Language Model (100% RNN).

• RWKV-4-Novel-ChnEng : 50% Chinese + 50% Pile
• RWKV-4-Novel-ChnEng-ChnPro : RWKV-4-Novel-ChnEng finetuned on high-quality professional Chn novels
• RWKV-4-Novel-Chn : 100% Chinese