| license: apache-2.0 | |
| pipeline_tag: text-generation | |
| # Grok-1 | |
| This repository contains the weights of the Grok-1 open-weights model. | |
| Make sure to download the `int8` checkpoint to the `checkpoints` directory. | |
| ```shell | |
| huggingface-cli download xai-org/grok-1 --repo-type model --include ckpt/tensor* --local-dir checkpoints/ckpt-0 --local-dir-use-symlinks False | |
| ``` | |
| Then, you can run: | |
| ```shell | |
| pip install -r requirements.txt | |
| python transformer.py | |
| ``` | |
| to test the code. | |
| You should be seeing output from the language model. | |
| Due to the large size of the model (314B parameters), a multi-GPU machine is required to test the model with the example code. |