|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- togethercomputer/RedPajama-Data-1T |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
tags: |
|
- sharded |
|
- bf16 |
|
- base |
|
--- |
|
|
|
# RedPajama-INCITE-7B-Base-sharded-bf16 |
|
|
|
|
|
This is the `togethercomputer/RedPajama-INCITE-7B-Base` model, but the model file(s) have been sharded to ~2GB each to ensure it can be loaded on low-RAM runtimes (like Colab). |
|
|
|
Please refer to the [original model card](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) for all details/issues w.r.t. to this model. |
|
- inference examples are also available on the original model card linked above. |
|
- [example colab notebook](https://colab.research.google.com/gist/pszemraj/d2f73ceaf4939bc55bdf5692cd0302d6/scratchpad.ipynb) covering the basics |
|
--- |
|
|
|
|
