llama-2-7b-chat-hf-Qlora-Samantha-V2-ggml-q4

Runtime error

RoversX commited on Aug 7, 2023

Commit

f378581

•

1 Parent(s): 686a3bb

Update config.yml

Files changed (1) hide show

config.yml CHANGED Viewed

@@ -9,8 +9,8 @@ chat:
   stop:
     - "</s>"
     - "<unk>"
-    - "### Human:"
-    - "Human:"
 queue:
   max_size: 16
   concurrency_count: 1  # leave this at 1, llama-cpp-python doesn't handle concurrent requests and will crash the entire app

   stop:
     - "</s>"
     - "<unk>"
+    - "### human:"
+    - "human:"
 queue:
   max_size: 16
   concurrency_count: 1  # leave this at 1, llama-cpp-python doesn't handle concurrent requests and will crash the entire app