Felladrin/llama2_xs_460M_experimental_evol_instruct-GGUF

Quantized GGUF model files for llama2_xs_460M_experimental_evol_instruct from Felladrin

Name	Quant method	Size
llama2_xs_460m_experimental_evol_instruct.q2_k.gguf	q2_k	212.56 MB
llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf	q3_k_m	238.87 MB
llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf	q4_k_m	288.52 MB
llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf	q5_k_m	333.29 MB
llama2_xs_460m_experimental_evol_instruct.q6_k.gguf	q6_k	380.87 MB
llama2_xs_460m_experimental_evol_instruct.q8_0.gguf	q8_0	492.67 MB

Original Model Card:

ahxt's llama2_xs_460M_experimental trained on the WizardLM's Evol Instruct dataset using AutoTrain

• Base model: ahxt/llama2_xs_460M_experimental
• Dataset: KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
• Training: 13.5h under these parameters

Recommended Prompt Format

### Instruction:
<instruction>

### Response:

Recommended Inference Parameters

repetition_penalty: 1.15
do_sample: true
temperature: 0.5
top_p: 0.5