|
|
--- |
|
|
license: mit |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- cortex.cpp |
|
|
- featured |
|
|
--- |
|
|
|
|
|
## Overview |
|
|
|
|
|
**Microsoft Research** developed and released the **Phi-4-reasoning** series, a cutting-edge family of reasoning-focused language models optimized for chain-of-thought (CoT), step-by-step problem solving, and high-efficiency inference. These models excel in advanced mathematical reasoning, scientific Q&A, and instruction-following scenarios. |
|
|
|
|
|
The Phi-4 models introduce extended context lengths, ChatML reasoning templates, and strong performance on benchmark datasets, while maintaining compact sizes that are ideal for memory- and latency-constrained environments. |
|
|
|
|
|
## Variants |
|
|
|
|
|
### Phi-4-reasoning |
|
|
|
|
|
| No | Variant | Branch | Cortex CLI command | |
|
|
|----|-------------------------------------------------------------------------------------|------------|-------------------------------------| |
|
|
| 1 | [phi-4-mini-reasoning](https://huggingface.co/microsoft/phi-4-mini-reasoning) | 4b | `cortex run phi4:4b` | |
|
|
| 2 | [phi-4-reasoning](https://huggingface.co/microsoft/phi-4-reasoning-plus) | 14b | `cortex run phi4:14b` | |
|
|
| 3 | [phi-4-reasoning-plus](https://huggingface.co/microsoft/phi-4-reasoning-plus) | 14b-plus | `cortex run phi4:14b-plus` | |
|
|
|
|
|
Each branch supports multiple quantized GGUF versions: |
|
|
- **phi-4-mini-reasoning:** q2_k, q3_k_l, q3_k_m, q3_k_s, q4_k_m, q4_k_s, q5_k_m, q5_k_s, q6_k, q8_0 |
|
|
- **phi-4-reasoning:** q2_k, q3_k_l, q3_k_m, q3_k_s, q4_k_m, q4_k_s, q5_k_m, q5_k_s, q6_k, q8_0 |
|
|
- **phi-4-reasoning-plus:** q2_k, q3_k_l, q3_k_m, q3_k_s, q4_k_m, q4_k_s, q5_k_m, q5_k_s, q6_k, q8_0 |
|
|
|
|
|
## Use it with Jan (UI) |
|
|
|
|
|
1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart) |
|
|
2. Use in Jan model Hub: |
|
|
```bash |
|
|
cortexso/phi4 |
|
|
``` |
|
|
|
|
|
## Use it with Cortex (CLI) |
|
|
|
|
|
1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart) |
|
|
2. Run the model with command: |
|
|
```bash |
|
|
cortex run phi4 |
|
|
``` |
|
|
|
|
|
## Credits |
|
|
|
|
|
- **Author:** Microsoft Research |
|
|
- **Converter:** [Menlo Research](https://menlo.ai/) |
|
|
- **Original License:** [MIT License](https://opensource.org/license/mit/) |
|
|
- **Blogs:** [Phi-4 Reasoning Blog](https://www.microsoft.com/en-us/research/blog/) |
|
|
|
