tiiuae
/

Falcon3-7B-Base

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

puneeshkhanna commited on 10 days ago

Commit

a9c965c

•

1 Parent(s): f422761

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -31,7 +31,7 @@ Falcon3-7B-Base supports 4 languages (english, french, spanish, portuguese) and
   - Uses SwiGLU and RMSNorm
   - 32K context length
   - 131K vocab size
-- Pretrained on 14 Gigatokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 2048 H100 GPU chips
 - Supports EN, FR, ES, PT
 - Developed by [Technology Innovation Institute](https://www.tii.ae)
 - License: TII Falcon-LLM License 2.0

   - Uses SwiGLU and RMSNorm
   - 32K context length
   - 131K vocab size
+- Pretrained on 14 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 2048 H100 GPU chips
 - Supports EN, FR, ES, PT
 - Developed by [Technology Innovation Institute](https://www.tii.ae)
 - License: TII Falcon-LLM License 2.0