tsrivallabh commited on
Commit
24bbbf2
·
verified ·
1 Parent(s): 28e026d

Synced repo using 'sync_with_huggingface' Github Action

Browse files
Files changed (1) hide show
  1. fact_checker.py +2 -1
fact_checker.py CHANGED
@@ -98,7 +98,7 @@ class FactChecker:
98
  # LLM verification with distance-aware prompt
99
  evidence_str = "\n".join([f"- {e}" for e in evidence])
100
  prompt = f""" You are a powerful fact checker. Analyze the claim below against the provided verified information.
101
- Relying on the similarity scores, also carefully check whether all factual details in the claim (such as dates, names, locations, and events) exactly match the evidence.
102
  If there is any factual mismatch (for example, the date in the claim is different from the evidence), classify the claim as False. Any factual mismatch, even if the overall context is similar, should lead to a False classification.
103
  If the evidence is too vague or lacks strong matches, classify as Unverifiable.
104
  If evidence directly contradicts the claim, classify as False.
@@ -113,6 +113,7 @@ Evidence (with similarity scores):
113
 
114
  Guidelines:
115
  1. Give more weight to evidence with higher similarity scores, but do not ignore factual mismatches.
 
116
  2. Pay close attention to details such as dates, names, locations, and events.
117
  3. If the claim and evidence differ on any factual point, do not classify as True.
118
  4. Respond only in JSON format without any additional text.
 
98
  # LLM verification with distance-aware prompt
99
  evidence_str = "\n".join([f"- {e}" for e in evidence])
100
  prompt = f""" You are a powerful fact checker. Analyze the claim below against the provided verified information.
101
+ Relying on the similarity scores, also carefully check whether all factual details in the claim (such as dates, names, locations, and events) exactly match atleast one of the evidence. If from first evidence, evidence is not sufficient, use the next evidence to verify the claim.
102
  If there is any factual mismatch (for example, the date in the claim is different from the evidence), classify the claim as False. Any factual mismatch, even if the overall context is similar, should lead to a False classification.
103
  If the evidence is too vague or lacks strong matches, classify as Unverifiable.
104
  If evidence directly contradicts the claim, classify as False.
 
113
 
114
  Guidelines:
115
  1. Give more weight to evidence with higher similarity scores, but do not ignore factual mismatches.
116
+ 2. If any one piece of evidence independently supports the claim, without factual mismatches, classify as True.
117
  2. Pay close attention to details such as dates, names, locations, and events.
118
  3. If the claim and evidence differ on any factual point, do not classify as True.
119
  4. Respond only in JSON format without any additional text.