Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
kernels-community
/
quantization
like
1
Follow
kernels-community
37
kernel
License:
apache-2.0
Model card
Files
Files and versions
Community
1
refs/pr/1
quantization
/
gptq_marlin
Ctrl+K
Ctrl+K
3 contributors
History:
3 commits
danieldk
HF Staff
Sync with vLLM
0da5bf5
4 months ago
awq_marlin_repack.cu
Safe
8.79 kB
Add GPTQ-Marlin
5 months ago
gptq_marlin.cu
Safe
95.2 kB
Sync with vLLM
4 months ago
gptq_marlin_repack.cu
Safe
11.1 kB
Add GPTQ-Marlin
5 months ago
marlin.cuh
Safe
2.27 kB
Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm`
5 months ago
marlin_dtypes.cuh
Safe
1.99 kB
Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm`
5 months ago
