Hugging Face's logo

xDAN-AI
/
APUS-xDAN-4.0-MOE

GGUF
Inference Endpoints
conversational
Model card Files Community
3

Update README.md

#1
by xdantk - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+3
-3
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -40,11 +40,11 @@ make LLAMA_CUDA=1
40
  ### Interactive Chat
41
  ```python
42
 
43
- ./main -m APUS-xDAN-4.0-quanzied_version.gguf \
44
- --prompt "You are a helpful assistant." --chatml \
45
  --interactive \
46
  --temp 0.7 \
47
- --ctx-size 4096
48
  ```
49
  License
50
 
 
40
  ### Interactive Chat
41
  ```python
42
 
43
+ ./main -m APUS-xDAN4.0-MoE-0402.Q3_K_M_Matrix.gguf \
44
+ --prompt "You are a helpful assistant named APUS-xDAN4.0 MoE." --chatml \
45
  --interactive \
46
  --temp 0.7 \
47
+ --ctx-size 2048
48
  ```
49
  License
50