ChatGLM2-6B-GGLM

Can be loaded and used by chatglm.cpp

Integrated with langchain framework in CustomLLM form

chatglm_langchain.py

python chatglm_langchain.py

Prompt:  小明的妈妈有两个孩子,一个叫大明 另外一个叫什么?
小明的妈妈有两个孩子,一个叫大明,另外一个叫小明。

Use under the shell command line

chatglm -m ./models/chatglm2-6b-ggml.q8_0.bin -p 你好

chatglm

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.