glm-4-9b-chat-GGUF / README.md
apepkuss79's picture
Update README.md
0f3d2dd verified
|
raw
history blame
857 Bytes
metadata
license: other
license_name: glm-4
license_link: https://huggingface.co/THUDM/glm-4-9b-chat/blob/main/LICENSE
inference: false
base_model: THUDM/glm-4-9b-chat
model_creator: THUDM
model_name: glm-4-9b-chat
quantized_by: Second State Inc.
language:
  - zh
  - en
tags:
  - glm
  - chatglm
  - thudm

glm-4-9b-chat-GGUF

Original Model

THUDM/glm-4-9b-chat

Run with Gaianet

Prompt template:

prompt template: glm-4-chat

Context size:

chat_ctx_size: 128000

Run with GaiaNet:

Quantized with llama.cpp b3333