apepkuss79's picture
Update README.md
1c960c1 verified
|
raw
history blame
835 Bytes
metadata
license: apache-2.0

Phi-3-mini-4k-instruct-GGUF

Original Model

microsoft/Phi-3-mini-4k-instruct

Run with Gaianet

Prompt template:

prompt template: phi-3-chat

Context size:

chat_ctx_size: 4000

Run with GaiaNet:

Quantized with llama.cpp b3333