metadata

library_name: transformers
base_model:
  - Rombo-Org/Rombo-LLM-V3.0-Qwen-32b
license: apache-2.0
datasets:
  - NovaSky-AI/Sky-T1_data_17k
tags:
  - unsloth

Like my work? Support me on patreon for only $5 a month and get to vote on what model's i make next as well as get access to this org's private repo's

Subscribe bellow:

Patreon.com/Rombodawg

Rombo-LLM-V3.0-Qwen-32b

Rombo-LLM-V3.0-Qwen-32b is a Continued Finetune model on top of the previous V2.5 version using the "NovaSky-AI/Sky-T1_data_17k" dataset. The resulting model was then merged backed into the base model for higher performance as written in the continuous finetuning technique bellow. This model is a good general purpose model, however it excells at coding and math.

https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing

Original weights:

https://huggingface.co/Rombo-Org/Rombo-LLM-V3.0-Qwen-32b

Benchmarks: (Coming soon)