Text Generation
Transformers
English
llama

Model sometimes generate nothing

#4
by quannv - opened

Does it happen to anyone? I use stablebeluga2.ggmlv3.q4_K_M.bin to generate data from almost similar prompt like:
"""

System: This is a system prompt, please behave and help the user.

User:

                   {paragaph}
                   Questions: {Question}
                   Use information in the given paragraph to answer the Question

Assistant:

"""
GPU: 2x3090
n_gpu_layers : 60

Sign up or log in to comment