|
--- |
|
license: mit |
|
datasets: |
|
- BlossomsAI/reduced_vietnamese_instruction_dataset |
|
language: |
|
- en |
|
- vi |
|
base_model: |
|
- sail/Sailor2-8B |
|
--- |
|
<div align="center"> |
|
<img src="https://github.com/bloomifycafe/blossomsAI/blob/main/assets/logo.png?raw=true" alt="Logo"/> |
|
</div> |
|
</br> |
|
<div align="center"> |
|
|
|
# 🌟 BloomVN-8B-instruct |
|
|
|
</div> |
|
|
|
### A fine-tuned multilingual model for Vietnamese language |
|
|
|
## 📋 Overview |
|
|
|
- This model serves as an experimental implementation of instruction fine-tuning for Vietnamese language processing. Built primarily as a proof-of-concept to test unsloth's training capabilities, it was trained on a limited dataset. |
|
|
|
Key characteristics: |
|
- Experimental model focused on Vietnamese language |
|
- Limited training data |
|
- Primary purpose: Testing unsloth's training performance |
|
- Not intended for production use |
|
|
|
Note: This is a research prototype meant for evaluating training methodologies rather than practical applications. |
|
|
|
## 🔧 Method |
|
|
|
- The fine-tuning process was conducted using [unsloth](https://github.com/unslothai/unsloth), with the primary focus on running sample experiments to test the framework's capabilities. |
|
|
|
|
|
The experimentation involved: |
|
- Using unsloth for model fine-tuning |
|
- Running several basic test samples |
|
- Evaluating training behavior |
|
|
|
|
|
## 🤝 Contributors |
|
|
|
Developed with ❤️ by [BlossomAI](https://github.com/BlossomAI) |
|
|
|
<p align="left"> |
|
<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/made with unsloth.png" width="200" /> |
|
</p> |
|
|
|
--- |
|
<div align="center"> |
|
<sub>Star ⭐️ this repo if you find it valuable!</sub> |
|
</div> |
