HuggingFaceM4
/

idefics-80b-instruct

Text Generation

image-text-to-text

text-generation-inference

Model card Files Files and versions Community

Leyo commited on Oct 5, 2023

Commit

ddb9e04

•

1 Parent(s): d93a6e8

Revert "Upload tokenizer.json (#8)"

This reverts commit d93a6e878b99f8a22698647136e6410b9d6c4fe6.

Files changed (1) hide show

tokenizer.json +2 -8

tokenizer.json CHANGED Viewed

@@ -45,7 +45,7 @@
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
-      "normalized": true,
       "special": true
     },
     {
@@ -71,12 +71,6 @@
           "String": " "
         },
         "content": "▁"
-      },
-      {
-          "type":"Replace",
-          "pattern":{
-              "Regex":"!\\[\\]([^\\]]*)"},
-              "content":"<image>"
       }
     ]
   },
@@ -93421,4 +93415,4 @@
       "▁ ▁▁▁▁▁▁▁▁▁▁▁▁▁▁"
     ]
   }
-}

       "single_word": false,
       "lstrip": false,
       "rstrip": false,
+      "normalized": false,
       "special": true
     },
     {
           "String": " "
         },
         "content": "▁"
       }
     ]
   },
       "▁ ▁▁▁▁▁▁▁▁▁▁▁▁▁▁"
     ]
   }
+}