Hugging Face's logo

cortexso
/
intellect-2

Text Generation
GGUF
cortex.cpp
featured
conversational
Model card Files Community
intellect-2
File size: 2,065 Bytes 
4f04e5e
 
 
d8d26e2
 
 
4f04e5e
 
 
 
 
 
 
 
 
 
 
 
 
 
9d237b2
4f04e5e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d8d26e2
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
 
---
license: apache-2.0
pipeline_tag: text-generation
tags:
- cortex.cpp
- featured
---

## Overview

**Prime Intellect** released **INTELLECT-2**, a 32 billion parameter large language model (LLM) trained through distributed reinforcement learning on globally donated GPU resources. Built on the **Qwen2** architecture and fine-tuned with the **prime-rl** framework, INTELLECT-2 demonstrates strong performance in math, coding, and logical reasoning.

This model leverages GRPO (Generalized Reinforcement Policy Optimization) over verifiable rewards, introducing asynchronous distributed RL training with enhanced stability techniques. While its primary focus was on verifiable mathematical and coding tasks, it remains compatible with general-purpose text generation tasks.

## Variants

### INTELLECT-2

| No | Variant                                                                         | Branch | Cortex CLI command                 |
|----|----------------------------------------------------------------------------------|--------|-----------------------------------|
| 1  | [INTELLECT-2 (32B)](https://huggingface.co/cortexso/intellect-2/tree/32b) | 32b    | `cortex run intellect-2:32b`      |

Each branch includes multiple GGUF quantized versions, optimized for various hardware configurations:
- **INTELLECT-2-32B:** q2_k, q3_k_l, q3_k_m, q3_k_s, q4_k_m, q4_k_s, q5_k_m, q5_k_s, q6_k, q8_0

## Use it with Jan (UI)

1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
2. Use in Jan model Hub:
   ```bash
   cortexso/intellect-2
   ```

## Use it with Cortex (CLI)

1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
2. Run the model with command:
   ```bash
   cortex run intellect-2
   ```

## Credits

- **Author:** Prime Intellect
- **Converter:** [Menlo Research](https://menlo.ai/)
- **Original License:** [Apache-2.0](https://choosealicense.com/licenses/apache-2.0/)
- **Paper:** [Intellect 2 Technical Report](https://storage.googleapis.com/public-technical-paper/INTELLECT_2_Technical_Report.pdf)