Llama3.1-8B-Chinese-Chat-GGUF
Original Model
shenzhi-wang/Llama3.1-8B-Chinese-Chat
Run with LlamaEdge
Run with Gaianet
Prompt template:
prompt template: llama-3-chat
Context size:
chat_ctx_size: 128000
Run with GaiaNet:
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3463
- Downloads last month
- 96
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for gaianet/Llama3.1-8B-Chinese-Chat-GGUF
Base model
meta-llama/Llama-3.1-8B
Finetuned
meta-llama/Llama-3.1-8B-Instruct
Quantized
shenzhi-wang/Llama3.1-8B-Chinese-Chat