OpenMOSS, Fudan NLP, SII

fnlp's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

xpqiu 

authored a paper 13 days ago

World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning

Paper • 2503.10480 • Published 14 days ago • 46

TaoJi 

updated a dataset 14 days ago

fnlp/MHA2MLA-corpus-smollm_v1

Updated 14 days ago • 61

TaoJi 

updated a collection 14 days ago

MHA2MLA

Collection

The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs" • 19 items • Updated 14 days ago

TaoJi 

updated a dataset 14 days ago

fnlp/MHA2MLA-corpus-llama2

Updated 14 days ago • 73

TaoJi 

updated 15 models 14 days ago

fnlp/Llama-2-7B-MLA-d_kv_16

Text Generation • Updated 14 days ago • 611

fnlp/Llama-2-7B-MLA-d_kv_32

Text Generation • Updated 14 days ago • 166

fnlp/Llama-2-7B-MLA-d_kv_64

Text Generation • Updated 14 days ago • 28

fnlp/Llama-2-7B-MHA-d_kv_256

Text Generation • Updated 14 days ago • 17

fnlp/SmolLM-1B7-MLA-d_kv_8

Text Generation • Updated 14 days ago • 18

fnlp/SmolLM-1B7-MLA-d_kv_32

Text Generation • Updated 14 days ago • 24

fnlp/SmolLM-1B7-MLA-d_kv_16

Text Generation • Updated 14 days ago • 32

fnlp/SmolLM-1B7-MHA-d_kv_128

Text Generation • Updated 14 days ago • 21

fnlp/SmolLM-360M-MLA-d_kv_8

Text Generation • Updated 14 days ago • 23

fnlp/SmolLM-360M-MLA-d_kv_16

Text Generation • Updated 14 days ago • 19

fnlp/SmolLM-360M-MLA-d_kv_32

Text Generation • Updated 14 days ago • 18

fnlp/SmolLM-360M-GQA-d_kv_128

Text Generation • Updated 14 days ago • 18

fnlp/SmolLM-135M-MLA-d_kv_8

Text Generation • Updated 14 days ago • 39

fnlp/SmolLM-135M-MLA-d_kv_16

Text Generation • Updated 14 days ago

fnlp/SmolLM-135M-MLA-d_kv_32

Text Generation • Updated 14 days ago • 34