Tao Ji

TaoJi's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a paper 5 days ago

Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs

Paper • 2502.14837 • Published 19 days ago • 1

updated 11 models 6 days ago

fnlp/SmolLM-1B7-MHA-d_kv_128

Text Generation • Updated 6 days ago • 13

fnlp/SmolLM-1B7-MLA-d_kv_32

Text Generation • Updated 6 days ago • 15

fnlp/SmolLM-1B7-MLA-d_kv_16

Text Generation • Updated 6 days ago • 12

fnlp/SmolLM-1B7-MLA-d_kv_8

Text Generation • Updated 6 days ago • 13

fnlp/SmolLM-360M-GQA-d_kv_128

Text Generation • Updated 6 days ago • 12

fnlp/SmolLM-360M-MLA-d_kv_8

Text Generation • Updated 6 days ago • 13

fnlp/SmolLM-360M-MLA-d_kv_32

Text Generation • Updated 6 days ago • 10

fnlp/SmolLM-360M-MLA-d_kv_16

Text Generation • Updated 6 days ago • 13

fnlp/SmolLM-135M-GQA-d_kv_128

Text Generation • Updated 6 days ago • 16

fnlp/SmolLM-135M-MLA-d_kv_32

Text Generation • Updated 6 days ago • 13

fnlp/SmolLM-135M-MLA-d_kv_16

Text Generation • Updated 6 days ago

updated a collection 7 days ago

MHA2MLA

Collection

The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs" • 17 items • Updated 7 days ago

updated a model 7 days ago

fnlp/SmolLM-135M-MLA-d_kv_8

Text Generation • Updated 7 days ago • 15

updated a collection 7 days ago

MHA2MLA

Collection

The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs" • 17 items • Updated 7 days ago