SparseLLMs

community

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

Raincleared authored a paper 11 days ago

ConPET: Continual Parameter-Efficient Tuning for Large Language Models

Raincleared authored a paper 11 days ago

ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs

Raincleared authored a paper 11 days ago

ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models

View all activity

SparseLLM 's models 109

SparseLLM/BlockFFN-Small

Text Generation • Updated 12 days ago • 9

SparseLLM/BlockFFN-Medium

Text Generation • Updated 12 days ago • 10

SparseLLM/BlockFFN-Large

Text Generation • Updated 12 days ago • 9

SparseLLM/BlockFFN-XLarge

Text Generation • Updated 12 days ago • 10

SparseLLM/BlockFFN-3B-SFT-EAGLE

Text Generation • Updated 12 days ago • 9

SparseLLM/BlockFFN-3B-SFT

Text Generation • Updated 12 days ago • 18 • 1

SparseLLM/sparsing-law-2.4b-relu

Text Generation • Updated Apr 22 • 13

SparseLLM/ReluLLaMA-7B

Text Generation • 7B • Updated Dec 19, 2024 • 185 • 11

SparseLLM/sparsing-law-0.1b-relu

Text Generation • 0.2B • Updated Dec 12, 2024 • 4 • 2

SparseLLM/sparsing-law-1.2b-silu

Text Generation • Updated Nov 8, 2024 • 2

SparseLLM/sparsing-law-0.8b-silu

Text Generation • Updated Nov 8, 2024 • 2

SparseLLM/sparsing-law-0.4b-silu

Text Generation • Updated Nov 8, 2024 • 2

SparseLLM/sparsing-law-0.2b-silu

Text Generation • Updated Nov 8, 2024 • 2

SparseLLM/sparsing-law-1.2b-relu

Text Generation • Updated Nov 8, 2024 • 2

SparseLLM/sparsing-law-0.4b-relu

Text Generation • Updated Nov 7, 2024 • 3

SparseLLM/sparsing-law-0.8b-relu

Text Generation • Updated Nov 7, 2024 • 2

SparseLLM/sparsing-law-0.2b-relu

Text Generation • Updated Nov 7, 2024 • 2

SparseLLM/sparsing-law-0.1b-silu

Text Generation • Updated Nov 5, 2024 • 3

SparseLLM/ProSparse-MiniCPM-1B-sft

Text Generation • Updated Jun 3, 2024 • 6 • 3

SparseLLM/prosparse-llama-2-13b

Text Generation • 13B • Updated May 28, 2024 • 6 • 2

SparseLLM/prosparse-llama-2-7b

Text Generation • 7B • Updated May 28, 2024 • 371 • 15

SparseLLM/prosparse-llama-2-13b-predictor

Feature Extraction • Updated Mar 11, 2024 • 1

SparseLLM/prosparse-llama-2-13b-gguf

Feature Extraction • Updated Mar 11, 2024 • 11 • 1

SparseLLM/prosparse-llama-2-7b-predictor

Feature Extraction • Updated Mar 11, 2024 • 1

SparseLLM/prosparse-llama-2-7b-gguf

Feature Extraction • Updated Mar 11, 2024 • 11 • 1

SparseLLM/reglu-95B

Text Generation • 1B • Updated Feb 7, 2024 • 2

SparseLLM/reglu-90B

Text Generation • 1B • Updated Feb 7, 2024 • 2

SparseLLM/reglu-85B

Text Generation • 1B • Updated Feb 7, 2024 • 2

SparseLLM/reglu-80B

Text Generation • 1B • Updated Feb 7, 2024 • 2

SparseLLM/reglu-75B

Text Generation • 1B • Updated Feb 7, 2024 • 5