Vector Post-Training Quantization (VPTQ) Demo
Vector Post Training Quantization Inference Demo
2bit infer for llm
Vector Post Training Quantization Demo