FractalGPT
/

RuQwen2.5-3B-Instruct-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

marattt commited on 4 days ago

Commit

e8877ab

•

1 Parent(s): 2b97d63

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -29,7 +29,7 @@ pipeline_tag: text-generation
 - **Type**: Instruction-tuned Causal Language Model
 - **Training Stages**: Pretraining & Instruction Tuning
 - **Architecture**: Transformer with RoPE, SwiGLU, RMSNorm, and Attention QKV bias
-- **Layers**: 64
 - **Attention Heads (GQA)**: 16 for Q and 2 for KV
 - **Context Length**: Supports a full context of 131,072 tokens and generation of up to 8,192 tokens
 - **Quantization**: AWQ 4 bit

 - **Type**: Instruction-tuned Causal Language Model
 - **Training Stages**: Pretraining & Instruction Tuning
 - **Architecture**: Transformer with RoPE, SwiGLU, RMSNorm, and Attention QKV bias
+- **Layers**: 36
 - **Attention Heads (GQA)**: 16 for Q and 2 for KV
 - **Context Length**: Supports a full context of 131,072 tokens and generation of up to 8,192 tokens
 - **Quantization**: AWQ 4 bit