Hugging Face's logo

itdainb
/
SeaLLMs-v3-7B-Chat-bnb-4bit

Text Generation
Transformers
Safetensors
Vietnamese
English
qwen2
text-generation-inference
unsloth
trl
conversational
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

Uploaded model

  • Developed by: itdainb
  • License: apache-2.0
  • Finetuned from model : SeaLLMs/SeaLLMs-v3-7B-Chat

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
12
Safetensors
Model size
4.46B params
Tensor type
FP16
·
F32
·
U8
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for itdainb/SeaLLMs-v3-7B-Chat-bnb-4bit

Base model

SeaLLMs/SeaLLMs-v3-7B-Chat
Quantized
(13)
this model

Collection including itdainb/SeaLLMs-v3-7B-Chat-bnb-4bit