neuralmagic
/

zephyr-7b-beta-marlin

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

zephyr-7b-beta-marlin / quantization

1 contributor

History: 2 commits

robertgshaw2's picture

Create requirements.txt

396feff verified 11 months ago

apply_gptq_save_marlin.py

2.25 kB

Create quantization/apply_gptq_save_marlin.py 11 months ago
requirements.txt

52 Bytes

Create requirements.txt 11 months ago