Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models
Paper
•
2501.17088
•
Published
•
1
Mamba-Shedder
Compressed Mamba Models via Mamba-Shedder (Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models)
-
IntelLabs/Mamba-Shedder-Mamba-2.2B
Updated • 16 • 2Note Compressed Mamba-2.8B
-
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM
Updated • 12 • 2
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM-Alpaca
Updated • 18 • 2Note Compressed Mamba2-2.7B