walliyani's picture
1 1

walliyani

sadafwalliyani

AI & ML interests

None yet

Recent Activity

updated a Space 21 days ago
sadafwalliyani/IC_light_2
updated a dataset 4 months ago
sadafwalliyani/comic_books
View all activity

Organizations

ZeroGPU Explorers's profile picture WAudio's profile picture

sadafwalliyani's activity

updated a Space 21 days ago
reacted to ordagan's post with πŸ‘πŸ˜Ž 10 months ago
view post
Post
2174
Excited to introduce Jamba by AI21
ai21labs/Jamba-v0.1

We are thrilled to announce Jamba, the world’s first production-grade Mamba based model.

Key Features:
- First production-grade Mamba based model built on a novel SSM-Transformer hybrid architecture
- 3X throughput on long contexts compared to Mixtral 8x7B
- Democratizes access to a massive 256K context window
- The only model in its size class that fits up to 140K context on a single GPU

Jamba is based on a novel architecture that combines Mamba and Transformer. While our initial results show great efficiency gains, we expect this to be further explored and improved with the help of the community.

Check out our blog post for more info: https://ai21-labs.webflow.io/blog/announcing-jamba
  • 2 replies
Β·
updated a Space 11 months ago
New activity in collabora/WhisperSpeech 12 months ago
updated a Space about 1 year ago
updated a collection about 1 year ago