DavidAU commited on
Commit
f617a96
1 Parent(s): 7511632

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -2
README.md CHANGED
@@ -77,9 +77,17 @@ Definitely set a "hard limit" for role play and/or chat.
77
  Different quants will give you slightly different prose, with higher quants giving strongest level of detail, "there"
78
  and nuance. Q4+ recommended.
79
 
80
- Q2k: If you use this quant you may need to lower temp (less then 1) and raise rep pen (1.08+) to address quality loss.
81
 
82
- IQ4XS: This might be the quant with the most difference compared to other quants.
 
 
 
 
 
 
 
 
83
 
84
  Enjoy!
85
 
 
77
  Different quants will give you slightly different prose, with higher quants giving strongest level of detail, "there"
78
  and nuance. Q4+ recommended.
79
 
80
+ Q2K:
81
 
82
+ If you use this quant you may need to lower temp (less then 1) and raise rep pen (1.08+) to address quality loss.
83
+
84
+ IQ4XS:
85
+
86
+ This might be the quant with the most differences (contrast creavity) compared to other quants.
87
+
88
+ ARM QUANTS:
89
+
90
+ These quants are for specific systems that support this. If you use on a regular computer / GPU token per second will be VERY SLOW.
91
 
92
  Enjoy!
93