Arcee Maestro 7B Preview GGUF

Original model: Arcee Maestro 7B Preview

Model creator: Arcee AI

Arcee-Maestro-7B-Preview (7B) is Arcee's first reasoning model trained with reinforment learning. It is based on the Qwen2.5-7B DeepSeek-R1 distillation DeepSeek-R1-Distill-Qwen-7B with further GRPO training. Though this is just a preview of our upcoming work, it already shows promising improvements to mathematical and coding abilities across a range of tasks.

Reinforcement Learning: GRPO with 450,000 verified math problems with some coding examples

This repo contains GGUF format model files for Arcee AI’s Arcee Maestro 7B Preview.

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023.

Converted with llama.cpp build 4748 (revision c392e50), using autogguf-rs.

Prompt template: DeepSeek R1

{{system_message}}<|User|>{{prompt}}<|Assistant|><think>


Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs.ai

cnvrs is the best app for private, local AI on your device:


Original Model Evaluation

Arcee Maestro 7B preview shows great gains in mathematics and coding, surpassing O1 preview in many metrics.

arcee-maestro-7b-preview-evals

Downloads last month
727
GGUF
Model size
7.61B params
Architecture
qwen2

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for brittlewis12/Arcee-Maestro-7B-Preview-GGUF