Hugging Face's logo

mudler
/
Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

Transformers
llama-factory
llama3
Inference Endpoints
Model card Files Community
Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF / README.md
mudler's picture
mudler
Create README.md
90763ab verified
preview code
|
raw
history blame contribute delete
1.01 kB
metadata
library_name: transformers
tags:
  - llama-factory
  - llama3
license: llama3
datasets:
  - teknium/OpenHermes-2.5
  - mudler/function-call-localai-glaive

local-ai-banner.png

Mirai Nova

image/png

Mirai Nova: "Mirai" means future in Japanese, and "Nova" references a star showing a sudden large increase in brightness.

A set of models oriented in function calling, but generalist and with enhanced reasoning capability. This is fine tuned with Llama3.

Mirai Nova works particularly well with LocalAI, leveraging the function call with grammars feature out of the box.

GGUF quants fpr: https://huggingface.co/mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1

To run on LocalAI:

local-ai run huggingface://mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF/localai.yaml