Edit Models filters

Inference status

Misc

arxiv: 2402.13228

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

59

Full-text search

Active filters: 2402.13228

blockblockblock/Smaug-Llama-3-70B-Instruct-bpw3-exl2

Text Generation • Updated May 19, 2024 • 13 • 1

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-4_0bpw_exl2

Text Generation • Updated May 20, 2024 • 11

blockblockblock/Smaug-Llama-3-70B-Instruct-bpw3.5-exl2

Text Generation • Updated May 19, 2024 • 11

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-4_25bpw_exl2

Text Generation • Updated May 20, 2024 • 12

blockblockblock/Smaug-Llama-3-70B-Instruct-bpw3.7-exl2

Text Generation • Updated May 19, 2024 • 12

blockblockblock/Smaug-Llama-3-70B-Instruct-bpw4-exl2

Text Generation • Updated May 19, 2024 • 14

LoneStriker/Smaug-Llama-3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 12

LoneStriker/Smaug-Llama-3-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 14

LoneStriker/Smaug-Llama-3-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 12

LoneStriker/Smaug-Llama-3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 14

LoneStriker/Smaug-Llama-3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 17

LoneStriker/Smaug-Llama-3-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 12

LoneStriker/Smaug-Llama-3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 14

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-5_0bpw_exl2

Text Generation • Updated May 20, 2024 • 12

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-6_0bpw_exl2

Text Generation • Updated May 20, 2024 • 12

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-6_5bpw_exl2

Text Generation • Updated May 20, 2024 • 12

RichardErkhov/abacusai_-_Llama-3-Smaug-8B-4bits

Text Generation • Updated May 21, 2024 • 83

RichardErkhov/abacusai_-_Smaug-72B-v0.1-gguf

Updated Jun 18, 2024 • 23

speakleash/Bielik-11B-v2.2-Instruct

Text Generation • Updated Oct 26, 2024 • 8.58k • 57

speakleash/Bielik-11B-v2.1-Instruct

Text Generation • Updated Oct 26, 2024 • 1.29k • 3

QuantFactory/Bielik-11B-v2.2-Instruct-GGUF

Updated Aug 30, 2024 • 16 • 1

koesn/Llama-3-Smaug-8B-GGUF

Updated Sep 6, 2024 • 33

RichardErkhov/abacusai_-_Smaug-34B-v0.1-gguf

Updated Sep 15, 2024 • 2

QuantFactory/Bielik-11B-v2.3-Instruct-GGUF

Updated Sep 24, 2024 • 105 • 1

RichardErkhov/speakleash_-_Bielik-11B-v2.1-Instruct-gguf

Updated Oct 18, 2024

RichardErkhov/abacusai_-_Llama-3-Smaug-8B-gguf

Updated Nov 3, 2024 • 3

RichardErkhov/abacusai_-_Smaug-Mixtral-v0.1-gguf

Updated Nov 5, 2024 • 9

mav23/Bielik-11B-v2.2-Instruct-GGUF

Updated Nov 13, 2024 • 2

Remek/Bielik-11B-v2.3-Instruct

Text Generation • Updated Nov 19, 2024 • 13 • 1