File size: 850 Bytes
6954da4
 
946df44
 
 
 
 
 
 
 
6954da4
 
946df44
6954da4
3b16cfb
6954da4
946df44
6954da4
946df44
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
---
library_name: transformers
license: apache-2.0
datasets:
- ise-uiuc/Magicoder-OSS-Instruct-75K
language:
- en
base_model:
- meta-llama/Llama-2-7b-hf
pipeline_tag: text-generation
---

This is the backbone of our "the Code model" used in the paper "[DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging](https://arxiv.org/abs/2407.01470)".

The detailed training/evaluation information can be found at https://api.wandb.ai/links/merge_exp/jhdkzbi2.

For more details about this model, please refer to our paper.

If you found this model useful, please cite our paper:
```
@article{lin2024dogerm,
  title={DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging},
  author={Lin, Tzu-Han and Li, Chen-An and Lee, Hung-yi and Chen, Yun-Nung},
  journal={arXiv preprint arXiv:2407.01470},
  year={2024}
}
```