matchaaaaa commited on
Commit
1a0b022
1 Parent(s): 704254e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -19,9 +19,9 @@ pipeline_tag: text-generation
19
 
20
  Meet Chaifighter-v3! A flagship frankenmerge blend brewed with love by yours truly!
21
 
22
- Chaifighter-v3 brings back the hyper-attention of the original, vastly expands on the fixes used to make v2 usable, and is built on a modified [Chunky-Lemon-Cookie-11B](https://huggingface.co/FallenMerick/Chunky-Lemon-Cookie-11B). Moreover, it RoPEs up to 8K perfectly, and should work well at 12K and beyond.
23
 
24
- *Native Context Length: 4K/4096 (can be extended to 8K/8192 or more with RoPE)*
25
 
26
  ## Prompt Template: Alpaca/Alpaca-based
27
 
 
19
 
20
  Meet Chaifighter-v3! A flagship frankenmerge blend brewed with love by yours truly!
21
 
22
+ Chaifighter-v3 brings back the hyper-attention of the original, vastly expands on the fixes used to make v2 usable, and is built on a modified [Chunky-Lemon-Cookie-11B](https://huggingface.co/FallenMerick/Chunky-Lemon-Cookie-11B). Moreover, it RoPEs up to 8K perfectly, and should work well up to 16K.
23
 
24
+ *Native Context Length: 4K/4096 (can be extended to 16K/16384 with RoPE scaling)*
25
 
26
  ## Prompt Template: Alpaca/Alpaca-based
27