RedHatAI
/

Qwen2-0.5B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

alexmarques commited on Jul 18, 2024

Commit

a2590bd

·

verified ·

1 Parent(s): e53e755

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -13,10 +13,11 @@ license_link: https://www.apache.org/licenses/LICENSE-2.0
   - **Input:** Text
   - **Output:** Text
 - **Model Optimizations:**
   - **Weight quantization:** INT8
 - **Intended Use Cases:** Intended for commercial and research use in English. Similarly to [Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct), this models is intended for assistant-like chat.
 - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English.
-- **Release Date:** 7/2/2024
 - **Version:** 1.0
 - **License(s):** [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0)
 - **Model Developers:** Neural Magic

   - **Input:** Text
   - **Output:** Text
 - **Model Optimizations:**
+  - **Activation quantization:** INT8
   - **Weight quantization:** INT8
 - **Intended Use Cases:** Intended for commercial and research use in English. Similarly to [Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct), this models is intended for assistant-like chat.
 - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English.
+- **Release Date:** 7/12/2024
 - **Version:** 1.0
 - **License(s):** [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0)
 - **Model Developers:** Neural Magic