Let people vote on existing responses?
#73
by
endolith
- opened
Currently we give a query, two random chatbots reply to it, and we vote for which response is better.
It would save a lot of time and computation if more than one person was allowed to vote on each pair of responses. So in the battle arena, instead of submitting your own query, you could click a button to "vote on random results" and it would show you someone else's query and responses (with the model names hidden, of course) and you could vote on which response is better, to add another battle to the dataset, from a different person's perspective, without the cost and time of generating a new completion.