Update README.md
Browse files
README.md
CHANGED
|
@@ -26,7 +26,8 @@ Minimum Environment: T4 GPU (The free of charge Google Colab T4, should run fine
|
|
| 26 |
or just run all this Colab (make sure you select T4 GPU):
|
| 27 |
https://colab.research.google.com/drive/1lp-JygPxsaQp-NdB7Mh_uVVYeIIXcAlt?usp=sharing
|
| 28 |
|
| 29 |
-
Notice: Since it is a 7B parameter model, it takes some time to load all the safetensors.
|
|
|
|
| 30 |
|
| 31 |
```python
|
| 32 |
# Upgrade in case bitsandbytes already installed
|
|
|
|
| 26 |
or just run all this Colab (make sure you select T4 GPU):
|
| 27 |
https://colab.research.google.com/drive/1lp-JygPxsaQp-NdB7Mh_uVVYeIIXcAlt?usp=sharing
|
| 28 |
|
| 29 |
+
Notice: Since it is a 7B parameter model, in FP32 and it takes some time to load all the safetensors.
|
| 30 |
+
An alternative, 4-bit quantized will be uploaded soon.
|
| 31 |
|
| 32 |
```python
|
| 33 |
# Upgrade in case bitsandbytes already installed
|