File size: 674 Bytes
7cf63ef 7833e37 a9b3a85 7833e37 130c896 fed4d7a |
1 2 3 4 5 6 7 8 9 10 11 |
---
license: apache-2.0
---
Detects if ChatGPT generated the answer given a prompt and answer pair (QA).
[DeBERTa-v3-Large model](microsoft/deberta-v3-large) fine-tuned on [GPT Wiki intro](https://huggingface.co/datasets/aadityaubhat/GPT-wiki-intro) and [HC3](https://huggingface.co/datasets/Hello-SimpleAI/HC3) dataset.
Fine-tuning was done for 1 epoch with 8:2 train/validation split. Recorded a validation accuracy of 99% for both GPT Wiki intro and HC3 after the 1st epoch.
This model recorded an accuracy of 93.467% on the public leaderboard of Kaggle's [Detect ChatGPT Answers Contest](https://www.kaggle.com/competitions/ml-olympiad-detect-chatgpt-answers/data) |