explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ

Ragas Critic Model

Model to be used as part of ragas synthetic test data generation to replace GPT-4 as critic model. To know more about this visit ragas

Take it for a spin

from langchain_community.llms import VLLM

llm = VLLM(
    model="explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ",
    trust_remote_code=True,  # mandatory for hf models
    max_new_tokens=512,
    top_k=10,
    top_p=0.95,
    temperature=0.0,)


template = "<|im_start|>user\n{}<|im_end|>\n<|im_start|>assistant\n"
input_text = """"""

simple_instruction = template.format(input_text)

llm.invoke(simple_instruction)

Generate synthetic QA pairs from Documents

Use the notebook here