Compressed LMs

AI & ML interests

None defined yet.

espressor's activity

xzyao

updated 8 models 3 months ago

espressor/google.gemma-2b-it_W8A8_int8

Text Generation • Updated Dec 12, 2024 • 26

espressor/google.gemma-2b-it_W4A16

Text Generation • Updated Dec 12, 2024 • 14

espressor/google.gemma-2b-it_W8A8_FP8

Text Generation • Updated Dec 12, 2024 • 10

espressor/google.gemma-7b-it_W8A8_FP8

Text Generation • Updated Dec 12, 2024 • 10

espressor/google.gemma-2-9b-it_W8A8_FP8

Text Generation • Updated Dec 12, 2024 • 10

espressor/google.gemma-2-2b-it_W8A8_int8

Text Generation • Updated Dec 12, 2024 • 15

espressor/google.gemma-2-2b-it_W4A16

Text Generation • Updated Dec 12, 2024 • 12

espressor/google.gemma-2-2b-it_W8A8_FP8

Text Generation • Updated Dec 12, 2024 • 14

xzyao

updated 12 models 4 months ago

espressor/meta-llama.Llama-2-70b-chat-hf_W8A8_FP8

Text Generation • Updated Nov 28, 2024 • 9

espressor/meta-llama.Meta-Llama-3-70B-Instruct_W8A8_FP8

Text Generation • Updated Nov 28, 2024 • 10

espressor/meta-llama.Llama-2-13b-chat-hf_W8A8_FP8

Text Generation • Updated Nov 28, 2024 • 11

espressor/meta-llama.Llama-3.1-70B-Instruct_W8A8_FP8

Text Generation • Updated Nov 28, 2024 • 9

espressor/meta-llama.Llama-2-7b-chat-hf_W8A8_int8

Text Generation • Updated Nov 28, 2024 • 7

espressor/meta-llama.Llama-2-7b-chat-hf_W4A16

Text Generation • Updated Nov 28, 2024 • 17

espressor/meta-llama.Meta-Llama-3-8B-Instruct_W8A8_int8

Text Generation • Updated Nov 28, 2024 • 19

espressor/meta-llama.Llama-2-7b-chat-hf_W8A8_FP8

Text Generation • Updated Nov 28, 2024 • 13

espressor/meta-llama.Meta-Llama-3-8B-Instruct_W4A16

Text Generation • Updated Nov 28, 2024 • 9

espressor/meta-llama.Llama-3.1-8B-Instruct_W8A8_int8

Text Generation • Updated Nov 28, 2024 • 33

espressor/meta-llama.Meta-Llama-3-8B-Instruct_W8A8_FP8

Text Generation • Updated Nov 28, 2024 • 9

espressor/meta-llama.Llama-3.1-8B-Instruct_W4A16

Text Generation • Updated Nov 28, 2024 • 29