File size: 1,150 Bytes
1bdb97d 8b91e20 1bdb97d 42bc97e 1bdb97d 8b91e20 8252cf2 1bdb97d 8b91e20 1bdb97d 8b91e20 1bdb97d 8b91e20 1bdb97d 8b91e20 1bdb97d 8b91e20 1bdb97d 8b91e20 1bdb97d 8b91e20 1bdb97d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
---
library_name: transformers
license: mit
datasets:
- Sp1786/multiclass-sentiment-analysis-dataset
base_model:
- bigscience/bloom
pipeline_tag: text-classification
---
### Model Description
- **Developed by:** Aman Prakash
- **Model type:** Decoder only LLM
- **Language(s) (NLP):** All suported by Bloom-1.7B, but primarily finetuned on English Dataset.
- **License:** MIT
- **Finetuned from model:** Bloom-1.7B
## Uses
For Sentiment Analysis Classification with 3 class - 0 - negative, 1 - neutral, 2 - positive.
### Downstream Use
Sentiment Analysis Classification
## Training Details
### FineTuning Data
[Sp1786/multiclass-sentiment-analysis-dataset](https://huggingface.co/datasets/Sp1786/multiclass-sentiment-analysis-dataset)
[More Information Needed]
### Training Procedure
LoRA with rank 8.
#### Training Hyperparameters
per_device_train_batch_size=4,
per_device_eval_batch_size=4,
gradient_accumulation_steps=4,
eval_strategy="steps",
eval_steps=200,
logging_steps=100,
num_train_epochs=2,
learning_rate=2e-4,
fp16=True,
save_steps=500,
save_total_limit=2,
|