README.md

metadata

license: other
license_name: tongyi-qianwen-license-agreement
license_link: >-
  https://huggingface.co/Qwen/Qwen1.5-14B/blob/39b74a78357df4d2296e838d87565967d663a67a/LICENSE
base_model: OpenBuddy/openbuddy-qwen1.5-14b-v20.1-32k

• GGUF importance matrix (imatrix) quants for https://huggingface.co/OpenBuddy/openbuddy-qwen1.5-14b-v20.1-32k
• The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
• The imatrix is being used on the K-quants as well.

Layers	Context	Template
40	32768	<|im_start|>user {prompt}<|im_end|> <|im_start|>assistant {response}