wanadzhar913
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -6,6 +6,7 @@ language:
|
|
6 |
- ms
|
7 |
base_model:
|
8 |
- mesolitica/malaysian-mistral-7b-32k-instructions-v4
|
|
|
9 |
---
|
10 |
### Model Details
|
11 |
This model was originally developed as part of the 1st place solution for the [AI Tinkerer's Hackathon in Kuala Lumpur](https://www.linkedin.com/posts/supa-ai_llms-techinnovation-llm-activity-7256832143694192640-INSI?utm_source=share&utm_medium=member_desktop)
|
@@ -31,6 +32,8 @@ Overall, solely training on the [Boolq-Malay](https://huggingface.co/datasets/wa
|
|
31 |
- **bf16 (Brain Floating Point 16-bit):** False
|
32 |
- **Train Loss:** 0.0524
|
33 |
|
|
|
|
|
34 |
The **Weights and Biases training run** can be found here: https://wandb.ai/adzhar-faiq/finetune-malaysian-mistral-llmasajudge-v2
|
35 |
|
36 |
For NLI benchmarks specifically, the **benchmarking notebook** can be found here: https://github.com/wanadzhar913/aitinkerers-hackathon-supa-team-werecooked/blob/master/notebooks-benchmarking-exercises/03_benchmark_malaysian_mistral_llmasajudge_v2.ipynb
|
|
|
6 |
- ms
|
7 |
base_model:
|
8 |
- mesolitica/malaysian-mistral-7b-32k-instructions-v4
|
9 |
+
pipeline_tag: text-generation
|
10 |
---
|
11 |
### Model Details
|
12 |
This model was originally developed as part of the 1st place solution for the [AI Tinkerer's Hackathon in Kuala Lumpur](https://www.linkedin.com/posts/supa-ai_llms-techinnovation-llm-activity-7256832143694192640-INSI?utm_source=share&utm_medium=member_desktop)
|
|
|
32 |
- **bf16 (Brain Floating Point 16-bit):** False
|
33 |
- **Train Loss:** 0.0524
|
34 |
|
35 |
+
The **training notebook** can be found here: https://github.com/wanadzhar913/aitinkerers-hackathon-supa-team-werecooked/blob/master/notebooks-finetuning-models/02_finetune_v2_malaysian_mistral_7b_32k_instructions_v4.ipynb
|
36 |
+
|
37 |
The **Weights and Biases training run** can be found here: https://wandb.ai/adzhar-faiq/finetune-malaysian-mistral-llmasajudge-v2
|
38 |
|
39 |
For NLI benchmarks specifically, the **benchmarking notebook** can be found here: https://github.com/wanadzhar913/aitinkerers-hackathon-supa-team-werecooked/blob/master/notebooks-benchmarking-exercises/03_benchmark_malaysian_mistral_llmasajudge_v2.ipynb
|