Update README.md
Browse filesI really need to continue working on these
README.md
CHANGED
@@ -5,9 +5,8 @@ language:
|
|
5 |
---
|
6 |
# scripts
|
7 |
|
8 |
-
Personal scripts to automate some tasks.\
|
9 |
-
|
10 |
-
Feel free to send in PRs or use this code however you'd like. External downloaded code after running are AGPL 3.0 but anything I write is unlicense.\
|
11 |
*[GitHub mirror](https://github.com/anthonyg5005/hf-scripts)*
|
12 |
|
13 |
**For GitHub**: Would recommend creating pull requests and discussions on the [offical huggingface repo](https://huggingface.co/Anthonyg5005/hf-scripts)
|
@@ -27,15 +26,13 @@ Feel free to send in PRs or use this code however you'd like. External downloade
|
|
27 |
## work in progress/not tested (ordered by priority)
|
28 |
|
29 |
- Easy exl2 quants
|
30 |
-
- Allow using finegrained tokens to login scripts
|
31 |
- Add custom safetensors shard size.
|
32 |
- Local model support.
|
|
|
33 |
|
34 |
## other recommended stuff
|
35 |
|
36 |
-
- [Exllama Discord server](https://discord.gg/NSFwVuCjRq)
|
37 |
-
- existing quants under the HF account [@blockblockblock](https://huggingface.co/blockblockblock)
|
38 |
-
- quant website some day
|
39 |
|
40 |
- [Download models](https://github.com/oobabooga/text-generation-webui/blob/main/download-model.py) (download HF Hub models) [Oobabooga]
|
41 |
|
@@ -49,7 +46,7 @@ Feel free to send in PRs or use this code however you'd like. External downloade
|
|
49 |
- Easily creates environment to quantize models to exl2 to your local machine. Supports both Windows and Linux.
|
50 |
|
51 |
- Upload folder to repo
|
52 |
-
- Uploads user specified folder to specified repo, can create private repos too. Not the same as git commit and push, instead uploads any additional files. This is more
|
53 |
|
54 |
- Manage branches
|
55 |
- Run script and follow prompts. You will be required to be logged in to HF Hub. If you are not logged in, you will need a WRITE token. You can get one in your [HuggingFace settings](https://huggingface.co/settings/tokens). Colab and Kaggle secret keys are supported.
|
@@ -57,7 +54,7 @@ Feel free to send in PRs or use this code however you'd like. External downloade
|
|
57 |
- EXL2 Single Quant
|
58 |
- Allows you to quantize to exl2 using colab. This version creates a exl2 quant to upload to private repo. Only 7B tested on colab.
|
59 |
|
60 |
-
- Download models
|
61 |
- To use the script, open a terminal and run '`python download-model.py USER/MODEL:BRANCH`'. There's also a '`--help`' flag to show the available arguments. To download from private repositories, make sure to login using '`huggingface-cli login`' or (not recommended) `HF_TOKEN` environment variable.
|
62 |
|
63 |
## extras
|
|
|
5 |
---
|
6 |
# scripts
|
7 |
|
8 |
+
Personal scripts to automate some tasks mostly using [huggingface_hub](https://github.com/huggingface/huggingface_hub).\
|
9 |
+
Feel free to send in PRs or use this code however you'd like.\
|
|
|
10 |
*[GitHub mirror](https://github.com/anthonyg5005/hf-scripts)*
|
11 |
|
12 |
**For GitHub**: Would recommend creating pull requests and discussions on the [offical huggingface repo](https://huggingface.co/Anthonyg5005/hf-scripts)
|
|
|
26 |
## work in progress/not tested (ordered by priority)
|
27 |
|
28 |
- Easy exl2 quants
|
|
|
29 |
- Add custom safetensors shard size.
|
30 |
- Local model support.
|
31 |
+
- Allow using finegrained tokens to login scripts
|
32 |
|
33 |
## other recommended stuff
|
34 |
|
35 |
+
- [Exllama Discord server](https://discord.gg/NSFwVuCjRq)
|
|
|
|
|
36 |
|
37 |
- [Download models](https://github.com/oobabooga/text-generation-webui/blob/main/download-model.py) (download HF Hub models) [Oobabooga]
|
38 |
|
|
|
46 |
- Easily creates environment to quantize models to exl2 to your local machine. Supports both Windows and Linux.
|
47 |
|
48 |
- Upload folder to repo
|
49 |
+
- Uploads user specified folder to specified repo, can create private repos too. Not the same as git commit and push, instead uploads any additional files. This is more of a practice for me than for actual usage.
|
50 |
|
51 |
- Manage branches
|
52 |
- Run script and follow prompts. You will be required to be logged in to HF Hub. If you are not logged in, you will need a WRITE token. You can get one in your [HuggingFace settings](https://huggingface.co/settings/tokens). Colab and Kaggle secret keys are supported.
|
|
|
54 |
- EXL2 Single Quant
|
55 |
- Allows you to quantize to exl2 using colab. This version creates a exl2 quant to upload to private repo. Only 7B tested on colab.
|
56 |
|
57 |
+
- Download models (oobabooga)
|
58 |
- To use the script, open a terminal and run '`python download-model.py USER/MODEL:BRANCH`'. There's also a '`--help`' flag to show the available arguments. To download from private repositories, make sure to login using '`huggingface-cli login`' or (not recommended) `HF_TOKEN` environment variable.
|
59 |
|
60 |
## extras
|