wanadzhar913 commited on
Commit
2573a3b
·
verified ·
1 Parent(s): 95d4a13

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -6,6 +6,7 @@ language:
6
  - ms
7
  base_model:
8
  - mesolitica/malaysian-mistral-7b-32k-instructions-v4
 
9
  ---
10
  ### Model Details
11
  This model was originally developed as part of the 1st place solution for the [AI Tinkerer's Hackathon in Kuala Lumpur](https://www.linkedin.com/posts/supa-ai_llms-techinnovation-llm-activity-7256832143694192640-INSI?utm_source=share&utm_medium=member_desktop)
@@ -31,6 +32,8 @@ Overall, solely training on the [Boolq-Malay](https://huggingface.co/datasets/wa
31
  - **bf16 (Brain Floating Point 16-bit):** False
32
  - **Train Loss:** 0.0524
33
 
 
 
34
  The **Weights and Biases training run** can be found here: https://wandb.ai/adzhar-faiq/finetune-malaysian-mistral-llmasajudge-v2
35
 
36
  For NLI benchmarks specifically, the **benchmarking notebook** can be found here: https://github.com/wanadzhar913/aitinkerers-hackathon-supa-team-werecooked/blob/master/notebooks-benchmarking-exercises/03_benchmark_malaysian_mistral_llmasajudge_v2.ipynb
 
6
  - ms
7
  base_model:
8
  - mesolitica/malaysian-mistral-7b-32k-instructions-v4
9
+ pipeline_tag: text-generation
10
  ---
11
  ### Model Details
12
  This model was originally developed as part of the 1st place solution for the [AI Tinkerer's Hackathon in Kuala Lumpur](https://www.linkedin.com/posts/supa-ai_llms-techinnovation-llm-activity-7256832143694192640-INSI?utm_source=share&utm_medium=member_desktop)
 
32
  - **bf16 (Brain Floating Point 16-bit):** False
33
  - **Train Loss:** 0.0524
34
 
35
+ The **training notebook** can be found here: https://github.com/wanadzhar913/aitinkerers-hackathon-supa-team-werecooked/blob/master/notebooks-finetuning-models/02_finetune_v2_malaysian_mistral_7b_32k_instructions_v4.ipynb
36
+
37
  The **Weights and Biases training run** can be found here: https://wandb.ai/adzhar-faiq/finetune-malaysian-mistral-llmasajudge-v2
38
 
39
  For NLI benchmarks specifically, the **benchmarking notebook** can be found here: https://github.com/wanadzhar913/aitinkerers-hackathon-supa-team-werecooked/blob/master/notebooks-benchmarking-exercises/03_benchmark_malaysian_mistral_llmasajudge_v2.ipynb