Edit model card

Model Card for Model ID

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: [More Information Needed]
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: [More Information Needed]
  • Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Lora32_32-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8

Task Version Metric Value Stderr
kobest_boolq 0 acc 0.9573 ± 0.0054
macro_f1 0.9573 ± 0.0054
kobest_copa 0 acc 0.7820 ± 0.0131
macro_f1 0.7817 ± 0.0131
kobest_hellaswag 0 acc 0.5200 ± 0.0224
acc_norm 0.5380 ± 0.0223
macro_f1 0.5177 ± 0.0224
kobest_sentineg 0 acc 0.8942 ± 0.0155
macro_f1 0.8939 ± 0.0155
Downloads last month
10
Safetensors
Model size
10.8B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.