|
Two-Phase Fine-tuned BERT is an automatic evaluation system based on the bert-base-japanese model, designed to evaluate creativity and appropriateness in Japanese alternative uses task (AUT) (see the paper at https://link.springer.com/article/xx.xxxx/sxxxxx-xxx-xxxx-x). Enter the data consisting of prompts and responses, with one usage per line, separated by commas. You can input the data directly into the text box as shown in the demos, or upload a comma-separated CSV file or an xlsx file as input. The models available for evaluation also include One-phase Fine-tuned BERT except for Two-phase Fine-tuned BERT, both of which are applicable only to Japanese. Two-phase BERT is optimized for creativity scoring for responses with low practicality and can evaluate both appropriateness and creativity. On the other hand, One-phase BERT is designed solely for evaluating creativity in AUT responses. We recommend using cls-pooling as the pooling method. If an error occurs, try simplifying your data by reducing the number of rows. If this doesn’t resolve the issue, the input format may be incorrect. Please try saving the data again as a comma-separated CSV file before uploading it. This system uses the free servers provided by HuggingFace, which only support CPU processing, so it may run slowly. You can copy this space to your account (recommended) and choose upgraded hardware to improve processing speed. For further assistance or to report bugs, please contact [email protected]. |