--- library_name: transformers tags: [] --- # Model Card for Model ID ## Model Details ### Model Description This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. - **Developed by:** [More Information Needed] - **Funded by [optional]:** [More Information Needed] - **Shared by [optional]:** [More Information Needed] - **Model type:** [More Information Needed] - **Language(s) (NLP):** [More Information Needed] - **License:** [More Information Needed] - **Finetuned from model [optional]:** [More Information Needed] ### Model Sources [optional] - **Repository:** [More Information Needed] - **Paper [optional]:** [More Information Needed] - **Demo [optional]:** [More Information Needed] ## Uses ### Direct Use [More Information Needed] ### Downstream Use [optional] [More Information Needed] hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Dora16-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8 | Task |Version| Metric |Value | |Stderr| |----------------|------:|--------|-----:|---|-----:| |kobest_boolq | 0|acc |0.9530|± |0.0057| | | |macro_f1|0.9530|± |0.0057| |kobest_copa | 0|acc |0.7860|± |0.0130| | | |macro_f1|0.7858|± |0.0130| |kobest_hellaswag| 0|acc |0.5220|± |0.0224| | | |acc_norm|0.5560|± |0.0222| | | |macro_f1|0.5190|± |0.0223| |kobest_sentineg | 0|acc |0.8791|± |0.0164| | | |macro_f1|0.8786|± |0.0165|