DavidAU commited on
Commit
dc5c79f
1 Parent(s): a53a839

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md CHANGED
@@ -77,6 +77,33 @@ Special thanks to the model creators at COHEREFORAI for making such a fantastic
77
 
78
  [ https://huggingface.co/CohereForAI/c4ai-command-r-v01 ]
79
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
80
  <H2> TEST PROMPTS and OUTPUT TESTS:</H2>
81
 
82
  <h3> PROMPT #1 </h3>
 
77
 
78
  [ https://huggingface.co/CohereForAI/c4ai-command-r-v01 ]
79
 
80
+ <B>Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:</B>
81
+
82
+ In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
83
+
84
+ Set the "Smoothing_factor" to 1.5 to 2.5
85
+
86
+ : in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
87
+
88
+ : in text-generation-webui -> parameters -> lower right.
89
+
90
+ : In Silly Tavern this is called: "Smoothing"
91
+
92
+
93
+ NOTE: For "text-generation-webui"
94
+
95
+ -> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
96
+
97
+ Source versions (and config files) of my models are here:
98
+
99
+ https://huggingface.co/collections/DavidAU/d-au-source-files-for-gguf-exl2-awq-gptq-hqq-etc-etc-66b55cb8ba25f914cbf210be
100
+
101
+ OTHER OPTIONS:
102
+
103
+ - Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
104
+
105
+ - If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
106
+
107
  <H2> TEST PROMPTS and OUTPUT TESTS:</H2>
108
 
109
  <h3> PROMPT #1 </h3>