Update README
Browse files
README.md
CHANGED
|
@@ -1,3 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: gpl-3.0
|
| 3 |
---
|
|
|
|
| 1 |
+
# GGML quantized IDEA-CCNL/Ziya-LLaMA-13B-v1
|
| 2 |
+
* You need the latest version of llama-cpp or llama-cpp-python (to support ggml format v3).
|
| 3 |
+
* Currently llama-cmake can not tokenize '<human>', '<bot>' special tokens, I changed these to 🤖🧑 emojis.
|
| 4 |
+
* Promot like this:
|
| 5 |
+
```python
|
| 6 |
+
inputs = '🧑:' + query.strip() + '\n🤖:'
|
| 7 |
+
```
|
| 8 |
---
|
| 9 |
license: gpl-3.0
|
| 10 |
---
|