MambaSan-370m 🐍

MambaSan-370m is the first chat Japanese language model based on a state-space model architecture (Mamba).

The model is based on Albert Gu's and Tri Dao's work Mamba: Linear-Time Sequence Modeling with Selective State Spaces (paper) as well as their model implementation. .

The Code used for pretraining will soon be published on my github: https://github.com/lcabannes Citation

bibtex @misc{lcabannes2024MambaSan-370m, title = {MambaSan-370m}, author = {Loïc Cabannes}, year = {2024}, howpublished = {HuggingFace}, url = {https://huggingface.co/loiccabannes/MambaSan-370m/} }

Downloads last month
6
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Dataset used to train loiccabannes/MambaSan-370m

Collection including loiccabannes/MambaSan-370m