gghfez commited on
Commit
9bee3ef
1 Parent(s): 7f39c51

Create README.md

Browse files

Trained the eos_token into the lm_head.

This should allow qlora finetunes with 24 or even 16 GB of vram.

Files changed (1) hide show
  1. README.md +5 -0
README.md ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - Qwen/Qwen2.5-14B
5
+ ---