neuralmagic
/

Qwen2-1.5B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

alexmarques commited on Jul 18, 2024

Commit

3a444bb

·

verified ·

1 Parent(s): 0dd8306

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ license: apache-2.0
 license_link: https://www.apache.org/licenses/LICENSE-2.0
 ---
-# Qwen2-1.5B-Instruct-quantized.w8a16
 ## Model Overview
 - **Model Architecture:** Qwen2

 license_link: https://www.apache.org/licenses/LICENSE-2.0
 ---
+# Qwen2-1.5B-Instruct-quantized.w8a8
 ## Model Overview
 - **Model Architecture:** Qwen2