llmixer
/

QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2 / README.md

llmixer's picture

Update README.md

921308c verified 9 months ago

|

history blame contribute delete

258 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 2.5bpw
  - h6
  - exl2

Exllamav2 2.5bpw h6 quant for alchemonaut/QuartetAnemoi-70B-t0.0001.

Default calibration dataset.