duyluandethuong commited on
Commit
d64a0f2
·
verified ·
1 Parent(s): fe7b17a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -2
README.md CHANGED
@@ -28,15 +28,20 @@ To use GGUF format for Llama.cpp or running in LM Studio, Jan and other local so
28
 
29
  # How to use
30
 
31
- Install unsloth
 
 
32
 
33
  This sample use unsloth for colab, you may switch to unsloth only if you want
34
 
35
  ```
36
  pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
 
37
  ```
38
 
39
- ```
 
 
40
  alpaca_prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
41
 
42
  ### Instruction:
 
28
 
29
  # How to use
30
 
31
+ For faster startup, checkout the [Example notebook here](https://colab.research.google.com/drive/1h6NyOBCzSYrx-nBoRA1X40loIe2oTioA?usp=sharing)
32
+
33
+ ## Install unsloth
34
 
35
  This sample use unsloth for colab, you may switch to unsloth only if you want
36
 
37
  ```
38
  pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
39
+ pip install --no-deps "xformers<0.0.27" "trl<0.9.0" peft accelerate bitsandbytes
40
  ```
41
 
42
+ ## Run inference
43
+
44
+ ```python
45
  alpaca_prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
46
 
47
  ### Instruction: