README.md

---
license: apache-2.0
---
# Better Implementation for [*PairRM*](https://huggingface.co/llm-blender/PairRM)

# **Introduction**

This version of PairRM have some fixes on training process, which improve model's performance significantly.

## **Minor Fixes**

### Longer Context Length (2048 -> 3380)

Thanks to deberta's tokenzer, original PairRM model had enough Context Length.

But, the longer the better :>

---

## **Major Fixes**

### Change Prompt Format

Why use something like
```
<Response i + 1> {response}
```

So, I changed to a format based on Vicuna 1.1.

---

### Change Truncate side

The original process was using right side truncate even on Input. This can cause serious problem when Input exceeds model's seq len.

---

### Dataset Filter

There was decent amount of empty assistant response on original dataset. So, I dropped them.