README.md · lucadiliello/bleurt-tiny-512 at main

This model is based on a custom Transformer model that can be installed with:

pip install git+https://github.com/lucadiliello/bleurt-pytorch.git

Now load the model and make predictions with:

import torch
from bleurt_pytorch import BleurtConfig, BleurtForSequenceClassification, BleurtTokenizer

config = BleurtConfig.from_pretrained('lucadiliello/bleurt-tiny-512')
model = BleurtForSequenceClassification.from_pretrained('lucadiliello/bleurt-tiny-512')
tokenizer = BleurtTokenizer.from_pretrained('lucadiliello/bleurt-tiny-512')

references = ["a bird chirps by the window", "this is a random sentence"]
candidates = ["a bird chirps by the window", "this looks like a random sentence"]

model.eval()
with torch.no_grad():
    inputs = tokenizer(references, candidates, padding='longest', return_tensors='pt')
    res = model(**inputs).logits.flatten().tolist()
print(res)
# [0.8606632947921753, 0.7198279500007629]

Take a look at this repository for the definition of BleurtConfig, BleurtForSequenceClassification and BleurtTokenizer in PyTorch.