Ferret_7B / README.md
euclaise's picture
Update README.md
e292511
|
raw
history blame
648 Bytes
metadata
license: other
datasets:
  - euclaise/MiniCoT
  - euclaise/SciCoT
  - euclaise/symtune_mini
  - euclaise/gsm8k_self_correct
  - euclaise/mathoverflow-accepted
  - euirim/goodwiki

A pre-finetuning finetuned version of Mistral 7B 0.1, focused on CoT reasoning tasks.

Probably decent at reasoning, but also probably not great as a chat assistant- it's designed to be finetuned further to give it a friendlier style.

Current benchmarks aren't great for instruct models, so I've temporarily omitted them. I'm working on a benchmark suite for instruct models though, and will update this with scores when that is released.

Uses ChatML prompt formatting.