File size: 607 Bytes
ff96acc
1c24294
 
 
 
 
 
 
ff96acc
1c24294
 
 
ff96acc
1c24294
 
 
 
 
 
 
 
bd581a3
 
 
 
 
 
d35f7e1
bd581a3
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
language:
- en
tags:
- pytorch
- text-generation
- causal-lm
- rwkv
license: apache-2.0
datasets:
- the_pile

---

# RWKV-4 Novel Models

## Model Description

These are RWKV-4-Pile models finetuned on novels.

Currently I am doing it for Chn novels. More languages to come.

Use https://github.com/BlinkDL/ChatRWKV to run them.

See https://github.com/BlinkDL/RWKV-LM for details on the RWKV Language Model (100% RNN).

* RWKV-4-Novel-ChnEng : 50% Chinese + 50% Pile
* RWKV-4-Novel-ChnEng-ChnPro : RWKV-4-Novel-ChnEng finetuned on high-quality professional Chn novels
* RWKV-4-Novel-Chn : 100% Chinese