metadata
base_model:
- Qwen/Qwen2.5-7B-Instruct
datasets:
- chtmp223/CLIPPER
language:
- en
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
Qwen2.5-7B-CLIPPER
Qwen2.5-7B-CLIPPER is a fine-tuned version of https://huggingface.co/Qwen/Qwen2.5-7B-Instruct using supervised finetuning over chtmp223/CLIPPER dataset. Please check our paper for more details on the method.
📒 Model Details
Model Description
- Language(s) (NLP): English
- License: Apache-2.0
- Finetuned from model: https://huggingface.co/Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
Model Sources
- Repository: Github repository.
- Paper: https://arxiv.org/abs/2502.14854
💻 Training Details
Training Data
Training Procedure
| Configurations | Values |
|---|---|
| Hardware (Training and Inference) | 8xA100s |
| Tracking | wandb |
| batch size | 16 |
| gradient_checkpointing | True |
| learning_rate | 1.0e-6 |
| lr_scheduler_type | cosine |
| max_length | 131072 |
| num_train_epochs | 1 |