agents-course/First_agent_template · HfApiJson error: unknown variant 'vllm'

Hello 👋

I wanted to try the new mistralai/Mistral-Small-24B-Instruct-2501 as the base model for my agent

model = HfApiModel(
    max_tokens=2096,
    temperature=0.5,
    model_id='mistralai/Mistral-Small-24B-Instruct-2501',
    custom_role_conversions=None,
)

by I get the following error from the console:

HfApiJson(Deserialize(Error("unknown variant `vllm`, expected one of 
`text-generation-inference`, `transformers`, `allennlp`, `flair`, `espnet`, 
`asteroid`, `speechbrain`, `timm`, `sentence-transformers`, `spacy`, `sklearn`, 
`stanza`, `adapter-transformers`, `fasttext`, `fairseq`, `pyannote-audio`, 
`doctr`, `nemo`, `fastai`, `k2`, `diffusers`, `paddlenlp`, `mindspore`, 
`open_clip`, `span-marker`, `bertopic`, `peft`, `setfit`", line: 1, column: 
153)))

I have seen that in the model README.md of Mistral card it is mentioned library_name: vllm.
Do not know if it is something similar to this discussion or if I am missing something!
Thank you in advance 🤗