apepkuss79 commited on
Commit
11bc9a7
1 Parent(s): 0fdf7b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -3
README.md CHANGED
@@ -1,3 +1,43 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-Coder-3B-Instruct
3
+ license: other
4
+ license_name: qwen-research
5
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct/blob/main/LICENSEE
6
+ model_creator: Qwen
7
+ model_name: Qwen2.5-Coder-3B-Instruct
8
+ pipeline_tag: text-generation
9
+ library_name: transformers
10
+ quantized_by: Second State Inc.
11
+ tags:
12
+ - code
13
+ - codeqwen
14
+ - chat
15
+ - qwen
16
+ - qwen-coder
17
+ language:
18
+ - en
19
+ ---
20
+
21
+ # Qwen2.5-Coder-3B-Instruct-GGUF
22
+
23
+ ## Original Model
24
+
25
+ [Qwen/Qwen2.5-Coder-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct)
26
+
27
+ ## Run with Gaianet
28
+
29
+ **Prompt template**
30
+
31
+ prompt template: `chatml`
32
+
33
+ **Context size**
34
+
35
+ chat_ctx_size: `128000`
36
+
37
+ **Run with GaiaNet**
38
+
39
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
40
+
41
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
42
+
43
+ *Quantized with llama.cpp b4033*