OpenMOSS, Fudan NLP, SII

fnlp's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

TaoJi 

updated a dataset about 14 hours ago

fnlp/MHA2MLA-corpus-smollm_v1

Updated about 15 hours ago • 3

TaoJi 

updated a collection about 15 hours ago

MHA2MLA

Collection

The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs" • 19 items • Updated about 15 hours ago

TaoJi 

updated a dataset about 16 hours ago

fnlp/MHA2MLA-corpus-llama2

Updated about 19 hours ago • 6

TaoJi 

updated 16 models about 21 hours ago

fnlp/Llama-2-7B-MLA-d_kv_16

Text Generation • Updated about 21 hours ago • 66

fnlp/Llama-2-7B-MLA-d_kv_32

Text Generation • Updated about 21 hours ago • 18

fnlp/Llama-2-7B-MLA-d_kv_64

Text Generation • Updated about 21 hours ago • 17

fnlp/Llama-2-7B-MHA-d_kv_256

Text Generation • Updated about 21 hours ago • 8

fnlp/SmolLM-1B7-MLA-d_kv_8

Text Generation • Updated about 21 hours ago • 14

fnlp/SmolLM-1B7-MLA-d_kv_32

Text Generation • Updated about 21 hours ago • 18

fnlp/SmolLM-1B7-MLA-d_kv_16

Text Generation • Updated about 21 hours ago • 21

fnlp/SmolLM-1B7-MHA-d_kv_128

Text Generation • Updated about 21 hours ago • 13

fnlp/SmolLM-360M-MLA-d_kv_8

Text Generation • Updated about 21 hours ago • 18

fnlp/SmolLM-360M-MLA-d_kv_16

Text Generation • Updated about 21 hours ago • 14

fnlp/SmolLM-360M-MLA-d_kv_32

Text Generation • Updated about 21 hours ago • 12

fnlp/SmolLM-360M-GQA-d_kv_128

Text Generation • Updated about 21 hours ago • 13

fnlp/SmolLM-135M-MLA-d_kv_8

Text Generation • Updated about 21 hours ago • 34

fnlp/SmolLM-135M-MLA-d_kv_16

Text Generation • Updated about 21 hours ago

fnlp/SmolLM-135M-MLA-d_kv_32

Text Generation • Updated about 21 hours ago • 28

fnlp/SmolLM-135M-GQA-d_kv_128

Text Generation • Updated about 21 hours ago • 27