mlabonne
/

BigLlama-3.1-1T-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (1)

I ordered more hardware to quantize this. Just wait 2-3 weeks and I will make it, it's just ... 2TB can fit on my 2tb ssd, but where am I suppose to put the quants?

#5 opened 6 months ago by

Is there any point to this?

#4 opened 7 months ago by

Aw hell nah

#3 opened 7 months ago by

Recommended hardware?

#1 opened 7 months ago by