File size: 592 Bytes
40841fb 4e54de7 40841fb 7068ece 40841fb 7068ece 40841fb 7068ece 40841fb 4e54de7 40841fb 7068ece 40841fb 1a1685b 40841fb 1a1685b 40841fb 7068ece 40841fb cb57047 e2a923a cb57047 0e02750 40841fb |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
---
license: apache-2.0
---
Download a Model
```
cortex models pull mistral
```
Start the Engine
```
cortex engines
```
Start model
```
cortex models start mistral
```
Chat
```
cortex chat
```
Model Structure
```
7b-instruct-v0.1-gguf-Q2_K
7b-instruct-v0.1-gguf-Q4_K_M
7b-instruct-v0.1-gguf-Q6_K
7b-instruct-v0.1-gguf-Q8_0
7b-instruct-v0.2-gguf-Q2_K
7b-instruct-v0.2-gguf-Q4_K_M
7b-instruct-v0.2-gguf-Q6_K
7b-instruct-v0.2-gguf-Q8_0
7b-instruct-v0.1-tensorrtllm-windows-ada-int4
7b-instruct-v0.1-tensorrtllm-windows-turing-int4
7b-instruct-v0.1-tensorrtllm-windows-ampere-int4
``` |