van-qa commited on
Commit
f918f07
·
2 Parent(s): 6df67d9 5d61621

Merge branch 'main' of hf.co:cortexso/phi3 into gguf

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: ms-pl
3
+ ---
4
+
5
+ ## Overview
6
+
7
+ The [Phi-3](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct), state-of-the-art open model trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties. The model belongs to the Phi-3 family with the 4B, 7B version in two variants 8K and 128K which is the context length (in tokens) that it can support.
8
+
9
+ ## Variants
10
+
11
+ | No | Variant | Cortex CLI command |
12
+ | --- | --- | --- |
13
+ | 1 | [mini-onnx](https://huggingface.co/cortexso/phi3/tree/mini-onnx) | `cortex run phi3:mini-onnx` |
14
+ | 2 | [mini-gguf](https://huggingface.co/cortexso/phi3/tree/mini-gguf) | `cortex run phi3:mini-gguf` |
15
+ | 3 | [medium-gguf](https://huggingface.co/cortexso/phi3/tree/medium-gguf) | `cortex run phi3:medium-gguf` |
16
+ | 4 | [medium-onnx](https://huggingface.co/cortexso/phi3/tree/medium-onnx) | `cortex run phi3:medium-onnx` |
17
+
18
+ ## Use it with Jan (UI)
19
+
20
+ 1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
21
+ 2. Use in Jan model Hub:
22
+ ```
23
+ cortexso/phi3
24
+ ```
25
+
26
+ ## Use it with Cortex (CLI)
27
+
28
+ 1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
29
+ 2. Run the model with command:
30
+ ```
31
+ cortex run phi3
32
+ ```
33
+
34
+ ## Credits
35
+
36
+ - **Author:** Microsoft
37
+ - **Converter:** [Homebrew](https://www.homebrew.ltd/)
38
+ - **Original License:** [License](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct/blob/main/LICENSE)
39
+ - **Papers:** [Phi-3 Technical Report](https://arxiv.org/abs/2404.14219)