Hugging Face's logo

BanglaLLM
/
BanglaLLama-3.2-1b-unolp-culturax-base-v0.0.1

Safetensors
Bengali
English
llama
bangla
banglaLLM
banglaNLP
LLM
LLama
Transformer
nlp
bengali
Model card Files Community
nymtheescobar commited on
Commit
9993fb9
·
verified ·
1 Parent(s): 50497a2

Create readme

Browse files
Files changed (1) hide show
  1. README.md +10 -7
README.md CHANGED
@@ -14,8 +14,8 @@ tags:
14
  - LLM
15
  - LLama
16
  - Transformer
 
17
  - bengali
18
- - low_resource_model
19
  ---
20
 
21
  # Bangla LLaMA-3.2 1B unolp/Culturax Base v0.1 [pre-trained]
@@ -26,12 +26,10 @@ Welcome to the inaugural release of the Bangla LLaMA-3.2 1B unolp-culturax base
26
 
27
  ## Model description
28
 
29
- The Bangla LLaMA models have been enhanced and tailored specifically with an extensive Bangla vocabulary of 16,000 tokens, building upon the foundation set by the original LLaMA-3.2
30
-
31
  - **Model type:** A 1B parameter model for Causal LM pre-trained on unolp/culturax (subset: bn) dataset.
32
  - **Language(s):** Bangla and English
33
  - **License:** GNU General Public License v3.0
34
- - **Source Model:** [meta-llama/Meta-Llama-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B)
35
  - **Training Precision:** `float16`
36
  - **Code:** [GitHub](https://github.com/abhinand5/bangla-llama)
37
 
@@ -42,9 +40,14 @@ The Bangla LLaMA models have been enhanced and tailored specifically with an ext
42
  | Bangla LLaMA 7B Base | Base model | 12GB | LLaMA 7B | 7B | [HF Hub](https://huggingface.co/BanglaLLM/bangla-llama-7b-base-v0.1) |
43
  | Bangla LLaMA 13B Base | Base model | 4GB | LLaMA 13B | 13B | [HF Hub](https://huggingface.co/BanglaLLM/bangla-llama-13b-base-v0.1) |
44
  | Bangla LLaMA 7B Instruct | Instruction following model | 145k instructions | Bangla LLaMA 7B Base | 7B | [HF Hub](https://huggingface.co/BanglaLLM/bangla-llama-7b-instruct-v0.1) |
45
- | Bangla LLaMA 13B Instruct | Instruction following model | 145k instructions | Bangla LLaMA 13B Base | 13B | [HF Hub](BanglaLLM/bangla-llama-13b-instruct-v0.1)
46
- | Bangla LLaMA 3 8B Instruct | Instruction following model | 12.8M instructions | Bangla LLaMA 3 8B Base | 8B | [HF Hub](BanglaLLM/BanglaLLama-3-8b-bangla-alpaca-orca-instruct-v0.0.1)
47
- | Bangla LLaMA 3.1 8B Instruct | Instruction following model | 12.8M instructions | Bangla LLaMA 3.1 8B Base | 8B | [HF Hub](BanglaLLM/BanglaLLama-3.1-8b-bangla-alpaca-orca-instruct-v0.0.1)
 
 
 
 
 
48
 
49
  ## Usage Note
50
 
 
14
  - LLM
15
  - LLama
16
  - Transformer
17
+ - nlp
18
  - bengali
 
19
  ---
20
 
21
  # Bangla LLaMA-3.2 1B unolp/Culturax Base v0.1 [pre-trained]
 
26
 
27
  ## Model description
28
 
 
 
29
  - **Model type:** A 1B parameter model for Causal LM pre-trained on unolp/culturax (subset: bn) dataset.
30
  - **Language(s):** Bangla and English
31
  - **License:** GNU General Public License v3.0
32
+ - **Source Model:** [meta-llama/Meta-Llama-3.2-1B](https://huggingface.co/meta-llama/Meta-Llama-3.2-1B)
33
  - **Training Precision:** `float16`
34
  - **Code:** [GitHub](https://github.com/abhinand5/bangla-llama)
35
 
 
40
  | Bangla LLaMA 7B Base | Base model | 12GB | LLaMA 7B | 7B | [HF Hub](https://huggingface.co/BanglaLLM/bangla-llama-7b-base-v0.1) |
41
  | Bangla LLaMA 13B Base | Base model | 4GB | LLaMA 13B | 13B | [HF Hub](https://huggingface.co/BanglaLLM/bangla-llama-13b-base-v0.1) |
42
  | Bangla LLaMA 7B Instruct | Instruction following model | 145k instructions | Bangla LLaMA 7B Base | 7B | [HF Hub](https://huggingface.co/BanglaLLM/bangla-llama-7b-instruct-v0.1) |
43
+ | Bangla LLaMA 13B Instruct | Instruction following model | 145k instructions | Bangla LLaMA 13B Base | 13B | [HF Hub](https://huggingface.co/BanglaLLM/bangla-llama-13b-instruct-v0.1) |
44
+ | Bangla LLaMA 3 8B Base | Base model | 12.4M | LLaMA 3 8b | 8B | [HF Hub](https://huggingface.co/BanglaLLM/BanglaLLama-3-8b-unolp-culturax-base-v0.0.1)
45
+ | Bangla LLaMA 3 8B Instruct | Instruction following model | 172k instructions | Bangla LLaMA 3 8B Base | 8B | [HF Hub](https://huggingface.co/BanglaLLM/BanglaLLama-3-8b-bangla-alpaca-orca-instruct-v0.0.1)
46
+ | Bangla LLaMA 3.1 8B Base | Base model | 12.4M | LLaMA 3.1 8b | 8B | [HF Hub](https://huggingface.co/BanglaLLM/BanglaLLama-3.1-8b-unolp-culturax-base-v0.0.1)
47
+ | Bangla LLaMA 3.1 8B Instruct | Instruction following model | 172k instructions | Bangla LLaMA 3.1 8B Base | 8b | [HF Hub](https://huggingface.co/BanglaLLM/BanglaLLama-3.1-8b-bangla-alpaca-orca-instruct-v0.0.1)
48
+ | Bangla LLaMA 3.2 3B Base | Base model | 12.4M | LLaMA 3.2 1b | 1b | [HF Hub](https://huggingface.co/BanglaLLM/BanglaLLama-3.2-3b-unolp-culturax-base-v0.0.3)
49
+ | Bangla LLaMA 3.2 1B Instruct | Instruction following model | 172k instructions | Bangla LLaMA 3.2 1B Base | 1b | [HF Hub](https://huggingface.co/BanglaLLM/BanglaLLama-3.2-1b-bangla-alpaca-orca-instruct-v0.0.1)
50
+ | Bangla LLaMA 3.2 3B Instruct| Instruction following model | 172k instructions | Bangla LLaMA 3.2 3B Base | 3B | [HF Hub](https://huggingface.co/BanglaLLM/BanglaLLama-3.2-3b-bangla-alpaca-orca-instruct-v0.0.1)
51
 
52
  ## Usage Note
53