glm-4-9b-chat-GGUF

Original Model

THUDM/glm-4-9b-chat

Run with Gaianet

Prompt template:

prompt template: glm-4-chat

Context size:

chat_ctx_size: 128000

Run with GaiaNet:

• Quick start with glm-4-9b-chat: https://github.com/GaiaNet-AI/node-configs/blob/main/glm-4-9b-chat/README.md

• Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b3333