alpindale
/

c4ai-command-r-plus-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Please provide onnx model along with inference script.

#7 opened 3 days ago by

VRAM requirement

#5 opened 8 months ago by

Can VLLM be used for loading?

#4 opened 9 months ago by

How many bits and what is the groupsize?

#3 opened 9 months ago by

What library was used to quantize the model?

#2 opened 9 months ago by

How to load command r+ in text-generation-webui?

#1 opened 9 months ago by

MLDataScientist