Update README.md
Browse files
README.md
CHANGED
@@ -28,15 +28,20 @@ To use GGUF format for Llama.cpp or running in LM Studio, Jan and other local so
|
|
28 |
|
29 |
# How to use
|
30 |
|
31 |
-
|
|
|
|
|
32 |
|
33 |
This sample use unsloth for colab, you may switch to unsloth only if you want
|
34 |
|
35 |
```
|
36 |
pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
|
|
|
37 |
```
|
38 |
|
39 |
-
|
|
|
|
|
40 |
alpaca_prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
|
41 |
|
42 |
### Instruction:
|
|
|
28 |
|
29 |
# How to use
|
30 |
|
31 |
+
For faster startup, checkout the [Example notebook here](https://colab.research.google.com/drive/1h6NyOBCzSYrx-nBoRA1X40loIe2oTioA?usp=sharing)
|
32 |
+
|
33 |
+
## Install unsloth
|
34 |
|
35 |
This sample use unsloth for colab, you may switch to unsloth only if you want
|
36 |
|
37 |
```
|
38 |
pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
|
39 |
+
pip install --no-deps "xformers<0.0.27" "trl<0.9.0" peft accelerate bitsandbytes
|
40 |
```
|
41 |
|
42 |
+
## Run inference
|
43 |
+
|
44 |
+
```python
|
45 |
alpaca_prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
|
46 |
|
47 |
### Instruction:
|