Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ license: mit
|
|
10 |
This is a mirror model to [mamba2-130m](https://huggingface.co/state-spaces/mamba2-130m) which is compatible with [mamba2-torch](https://github.com/vasqu/mamba2-torch), a Hugging Face compatible mamba2 library that is not dependent on the original cuda wheels of the [original mamba repo](https://github.com/state-spaces/mamba). Credit goes to the original authors of [Mamba2](https://arxiv.org/abs/2405.21060) and the [transformers](https://github.com/huggingface/transformers) library by Hugging Face. Without their work, this would not be possible.
|
11 |
|
12 |
|
13 |
-
NOTE: `mamba2-torch` offers
|
14 |
- Triton kernels and [causal-conv1d](https://github.com/Dao-AILab/causal-conv1d) ("fastest")
|
15 |
- Triton kernels only (default)
|
16 |
- Pure PyTorch
|
@@ -23,7 +23,7 @@ cd mamba2-torch
|
|
23 |
pip install .
|
24 |
```
|
25 |
|
26 |
-
Then you can
|
27 |
```python
|
28 |
from transformers import AutoTokenizer
|
29 |
from mamba2_torch import Mamba2Model, Mamba2ForCausalLM, Mamba2Config
|
|
|
10 |
This is a mirror model to [mamba2-130m](https://huggingface.co/state-spaces/mamba2-130m) which is compatible with [mamba2-torch](https://github.com/vasqu/mamba2-torch), a Hugging Face compatible mamba2 library that is not dependent on the original cuda wheels of the [original mamba repo](https://github.com/state-spaces/mamba). Credit goes to the original authors of [Mamba2](https://arxiv.org/abs/2405.21060) and the [transformers](https://github.com/huggingface/transformers) library by Hugging Face. Without their work, this would not be possible.
|
11 |
|
12 |
|
13 |
+
NOTE: `mamba2-torch` offers different optimisation paths to use:
|
14 |
- Triton kernels and [causal-conv1d](https://github.com/Dao-AILab/causal-conv1d) ("fastest")
|
15 |
- Triton kernels only (default)
|
16 |
- Pure PyTorch
|
|
|
23 |
pip install .
|
24 |
```
|
25 |
|
26 |
+
Then you can download this repository here via git lfs and then use the files locally the following way (after installing mamba2-torch):
|
27 |
```python
|
28 |
from transformers import AutoTokenizer
|
29 |
from mamba2_torch import Mamba2Model, Mamba2ForCausalLM, Mamba2Config
|