Martín Santillán Cooper commited on
Commit
07f01b6
1 Parent(s): 20a9c66

Update groundedness example

Browse files
Files changed (1) hide show
  1. catalog.json +3 -3
catalog.json CHANGED
@@ -91,9 +91,9 @@
91
  {
92
  "name": "groundedness",
93
  "criteria": "'Assistant' message is not grounded or faithful to the information provided in the 'Context'. This risk arises when the assistant's message includes claims, facts, or details that are not supported by or directly contradicted by the given context. An ungrounded answer may involve fabricating information, misinterpreting the context, or making unsupported extrapolations beyond what the context actually states.",
94
- "user_message": "What is an example of an organism that does not contain any repetitive DNA?",
95
- "assistant_message": "An example of an organism which does not contain any repetitive DNA is some plants and amphibians.",
96
- "context": "It had been found that the proportion of non-repetitive DNA can vary a lot between species. Some E. coli as prokaryotes only have non-repetitive DNA, lower eukaryotes such as C. elegans and fruit fly, still possess more non-repetitive DNA than repetitive DNA. Higher eukaryotes tend to have more repetitive DNA than non-repetitive ones. In some plants and amphibians, the proportion of non-repetitive DNA is no more than 20%, becoming a minority component."
97
  },
98
  {
99
  "name": "answer_relevance",
 
91
  {
92
  "name": "groundedness",
93
  "criteria": "'Assistant' message is not grounded or faithful to the information provided in the 'Context'. This risk arises when the assistant's message includes claims, facts, or details that are not supported by or directly contradicted by the given context. An ungrounded answer may involve fabricating information, misinterpreting the context, or making unsupported extrapolations beyond what the context actually states.",
94
+ "user_message": "What year was the film Eat first shown?",
95
+ "assistant_message": "The film Eat was first shown by Jonas Mekas on December 24, 1922 at the Washington Square Gallery at 530 West Broadway.",
96
+ "context": "Eat (1964) is a 45-minute underground film created by Andy Warhol and featuring painter Robert Indiana, filmed on Sunday, February 2, 1964, in Indiana's studio. The film was first shown by Jonas Mekas on July 16, 1964, at the Washington Square Gallery at 530 West Broadway.\nJonas Mekas (December 24, 1922 January 23, 2019) was a Lithuanian-American filmmaker, poet, and artist who has been called \"the godfather of American avant-garde cinema\". Mekas's work has been exhibited in museums and at festivals worldwide."
97
  },
98
  {
99
  "name": "answer_relevance",