This is a Deberta-v3 large NLI model that has been finetuned on augmented ANLI data to improve performance for faithfulness evaluation, particularly in a knowledge-grounded dialog setting. See https://aclanthology.org/2023.acl-short.79 for details. The model itself is based on https://huggingface.co/MoritzLaurer/DeBERTa-v3-large-mnli-fever-anli-ling-wanli For a convenient interface for scoring see our repository: https://github.com/julmaxi/with_a_little_push
Note that this is not the original model used in the paper but a retrained variant that has slightly better average performance.
- Downloads last month
- 1,248
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.