metadata
license: apache-2.0
Ragas Critic Model
Model to be used as part of ragas synthetic test data generation to replace GPT-4 as critic model. To know more about this visit ragas
Take it for a spin
from langchain_community.llms import VLLM
llm = VLLM(
model="explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ",
trust_remote_code=True, # mandatory for hf models
max_new_tokens=512,
top_k=10,
top_p=0.95,
temperature=0.0,)
template = "<|im_start|>user\n{}<|im_end|>\n<|im_start|>assistant\n"
input_text = """"""
simple_instruction = template.format(input_text)
llm.invoke(simple_instruction)
Generate synthetic QA pairs from Documents
Use the notebook here