Hugging Face's logo

ai21labs
/
Jamba-v0.1

Text Generation
Transformers
Safetensors
jamba
mamba
Mixture of Experts
custom_code
Inference Endpoints
Model card Files Community
50

Layer-Selective Rank Reduction

#25
by mizinovmv - opened
Discussion
mizinovmv

Try find top layers by laser:
https://github.com/mizinovmv/llm-ru/blob/main/laser_Jamba-v0.1.ipynb

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment