metadata

license: other
license_name: glm-4
license_link: https://huggingface.co/THUDM/glm-4-9b-chat/blob/main/LICENSE
inference: false
base_model: THUDM/glm-4-9b-chat
model_creator: THUDM
model_name: glm-4-9b-chat
quantized_by: Second State Inc.
language:
  - zh
  - en
tags:
  - glm
  - chatglm
  - thudm

glm-4-9b-chat-GGUF

Original Model

THUDM/glm-4-9b-chat

Run with Gaianet

Prompt template:

prompt template: gemma-instruct

Context size:

chat_ctx_size: 128000

Run with GaiaNet:

Quick start with glm-4-9b-chat: https://github.com/GaiaNet-AI/node-configs/blob/main/glm-4-9b-chat/README.md
Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b3333