base_model: ibm-granite/granite-3.0-3b-a800m-instruct-GGUF
license: apache-2.0
pipeline_tag: text-generation
tags:
- language
- granite-3.0
quantized_model: AliNemati
inference: false
model-index:
- name: granite-3.0-2b-instruct
results:
- task:
type: text-generation
dataset:
name: IFEval
type: instruction-following
metrics:
- type: pass@1
value: 52.27
name: pass@1
- type: pass@1
value: 8.22
name: pass@1
- task:
type: text-generation
dataset:
name: AGI-Eval
type: human-exams
metrics:
- type: pass@1
value: 40.52
name: pass@1
- type: pass@1
value: 65.82
name: pass@1
- type: pass@1
value: 34.45
name: pass@1
- task:
type: text-generation
dataset:
name: OBQA
type: commonsense
metrics:
- type: pass@1
value: 46.6
name: pass@1
- type: pass@1
value: 71.21
name: pass@1
- type: pass@1
value: 82.61
name: pass@1
- type: pass@1
value: 77.51
name: pass@1
- type: pass@1
value: 60.32
name: pass@1
- task:
type: text-generation
dataset:
name: BoolQ
type: reading-comprehension
metrics:
- type: pass@1
value: 88.65
name: pass@1
- type: pass@1
value: 21.58
name: pass@1
- task:
type: text-generation
dataset:
name: ARC-C
type: reasoning
metrics:
- type: pass@1
value: 64.16
name: pass@1
- type: pass@1
value: 33.81
name: pass@1
- type: pass@1
value: 51.55
name: pass@1
- task:
type: text-generation
dataset:
name: HumanEvalSynthesis
type: code
metrics:
- type: pass@1
value: 64.63
name: pass@1
- type: pass@1
value: 57.16
name: pass@1
- type: pass@1
value: 65.85
name: pass@1
- type: pass@1
value: 49.6
name: pass@1
- task:
type: text-generation
dataset:
name: GSM8K
type: math
metrics:
- type: pass@1
value: 68.99
name: pass@1
- type: pass@1
value: 30.94
name: pass@1
- task:
type: text-generation
dataset:
name: PAWS-X (7 langs)
type: multilingual
metrics:
- type: pass@1
value: 64.94
name: pass@1
- type: pass@1
value: 48.2
name: pass@1
osllm.ai Models Highlights Program
We believe there's no need to pay a token if you have a GPU on your computer.
Highlighting new and noteworthy models from the community. Join the conversation on Discord.
Official Website • Documentation • Discord
NEW: Subscribe to our mailing list for updates and news!
Email: [email protected]
Disclaimers
Osllm.ai is not the creator, originator, or owner of any model featured in the Community Model Program. Each Community Model is created and provided by third parties. Osllm.ai does not endorse, support, represent, or guarantee the completeness, truthfulness, accuracy, or reliability of any Community Model. You understand that Community Models can produce content that might be offensive, harmful, inaccurate, inappropriate, or deceptive. Each Community Model is the sole responsibility of the person or entity who originated it. Osllm.ai may not monitor or control the Community Models and cannot take responsibility for them. Osllm.ai disclaims all warranties or guarantees about the accuracy, reliability, or benefits of the Community Models. Furthermore, Osllm.ai disclaims any warranty that the Community Model will meet your requirements, be secure, uninterrupted, error-free, virus-free, or that any issues will be corrected. You are solely responsible for any damage resulting from your use of or access to the Community Models, downloading of any Community Model, or use of any other Community Model provided by or through Osllm.ai.