brittlewis12/aanaphi2-v0.1-GGUF

aanaphi2-v0.1 GGUF

Original model: aanaphi2-v0.1

Model creator: mobiuslabsgmbh

This repo contains GGUF format model files for Mobius Labs’ aanaphi2-v0.1.

aanaphi2-v0.1 is a finetuned (SFT + DPO) chat model based on Microsoft's Phi-2 base model (2.8B parameters).

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 2276 (revision b11a93d)

Prompt template

### Human: {{prompt}}
### Assistant: 

---

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs is the best app for private, local AI on your device:

• create & save Characters with custom system prompts & temperature settings
• download and experiment with any GGUF model you can find on HuggingFace!
• make it your own with custom Theme colors
• powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
• try it out yourself today, on Testflight!
• follow cnvrs on twitter to stay up to date

---

Original Model Evaluation

Models	phi-2	aanaphi2-v0.1
ARC (25-shot)	61.09	63.74
HellaSwag (10-shot)	75.11	78.30
MMLU (5-shot)	58.11	57.70
TruthfulQA-MC2	44.47	51.56
Winogrande (5-shot)	74.35	73.40
GSM8K (5-shot)	54.81	58.61
Average	61.33	63.89