Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

kernels-community
/

quantization

Model card Files Files and versions Community

quantization / fp8

2 contributors

History: 2 commits

danieldk's picture

danieldk HF staff

Sync with vLLM

0da5bf5 2 months ago

amd
Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 4 months ago
nvidia
Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 4 months ago
common.cu

5.71 kB

Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 4 months ago
common.cuh

5.63 kB

Sync with vLLM 2 months ago
fp8_marlin.cu

51.1 kB

Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 4 months ago