Commit
•
0b0363f
1
Parent(s):
3df4d03
Update README.md
Browse files
README.md
CHANGED
|
@@ -5,10 +5,10 @@ license: mit
|
|
| 5 |
|
| 6 |
|
| 7 |
This model is a part of two model series, AryaBhatta-1 and AryaBhatta-2 and is finetuned from HuggingFaceH4/zephyr-7b-gemma-v0.1 or Google/gemma and is finetuned on 9 Indian languages (Hindi, Tamil, Punjabi, Bengali, Gujarati, Oriya, Telugu, Kannada, Malayalam) plus English.
|
| 8 |
-
To improve the resoning and maths skills, we first SFT tune the gemma on Microsoft's Orca datasets.
|
| 9 |
|
| 10 |
There are two models. One finetuned on Google's Gemma and one fine-tuned on Zephyr's Gemma base. Repo for other one (Zephyr one): GenVRadmin/AryaBhatta-GemmaOrca-2-Merged
|
| 11 |
|
|
|
|
| 12 |
|
| 13 |
We utilize Orca maths Hindi dataset: GenVRadmin/Aryabhatta-Orca-Maths-Hindi \
|
| 14 |
And original Orca maths dataset: microsoft/orca-math-word-problems-200k
|
|
|
|
| 5 |
|
| 6 |
|
| 7 |
This model is a part of two model series, AryaBhatta-1 and AryaBhatta-2 and is finetuned from HuggingFaceH4/zephyr-7b-gemma-v0.1 or Google/gemma and is finetuned on 9 Indian languages (Hindi, Tamil, Punjabi, Bengali, Gujarati, Oriya, Telugu, Kannada, Malayalam) plus English.
|
|
|
|
| 8 |
|
| 9 |
There are two models. One finetuned on Google's Gemma and one fine-tuned on Zephyr's Gemma base. Repo for other one (Zephyr one): GenVRadmin/AryaBhatta-GemmaOrca-2-Merged
|
| 10 |
|
| 11 |
+
To improve the resoning and maths skills, we first SFT tune the gemma on Microsoft's Orca datasets.
|
| 12 |
|
| 13 |
We utilize Orca maths Hindi dataset: GenVRadmin/Aryabhatta-Orca-Maths-Hindi \
|
| 14 |
And original Orca maths dataset: microsoft/orca-math-word-problems-200k
|