Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2309.00071

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

555

Full-text search

Active filters: 2309.00071

TheBloke/alfred-40B-1023-AWQ

Text Generation • Updated Nov 17, 2023 • 10 • 5

maddes8cht/lightonai-alfred-40b-1023-gguf

Updated Nov 22, 2023 • 106

TheBloke/Yarn-Llama-2-70B-32k-AWQ

Text Generation • Updated Nov 21, 2023 • 9 • 2

TheBloke/Yarn-Llama-2-70B-32k-GPTQ

Text Generation • Updated Nov 21, 2023 • 30

TheBloke/Yarn-Llama-2-70B-32k-GGUF

Updated Nov 20, 2023 • 598 • 9

LoneStriker/Yarn-Llama-2-70b-32k-2.4bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 11

LoneStriker/Yarn-Llama-2-70b-32k-4.0bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 14 • 1

LoneStriker/Yarn-Llama-2-70b-32k-4.65bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 9

LoneStriker/Yarn-Llama-2-70b-32k-2.55bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 6

LoneStriker/Yarn-Llama-2-70b-32k-6.0bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 12 • 1

LoneStriker/Yarn-Llama-2-70b-32k-5.15bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 9

MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1

Text Generation • Updated Jan 16, 2024 • 19 • 1

NousResearch/Yarn-Solar-10b-64k

Text Generation • Updated Jan 18, 2024 • 4.04k • 15

NousResearch/Yarn-Solar-10b-32k

Text Generation • Updated Jan 18, 2024 • 2.37k • 10

MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26, 2024 • 987 • 4

tdh87/Yarn-Solar-10b-64k-SafeTensors

Updated Jan 29, 2024 • 22

MaziyarPanahi/Yarn-Solar-10b-64k-GGUF

Text Generation • Updated Feb 25, 2024 • 687 • 1

MaziyarPanahi/Yarn-Solar-10b-32k-GGUF

Text Generation • Updated Feb 26, 2024 • 752 • 1

LoneStriker/Llama-3-8B-Instruct-262k-GGUF

Text Generation • Updated Apr 26, 2024 • 10 • 2

LoneStriker/Llama-3-8B-Instruct-262k-3.0bpw-h6-exl2

Text Generation • Updated Apr 26, 2024 • 4

LoneStriker/Llama-3-8B-Instruct-262k-4.0bpw-h6-exl2

Text Generation • Updated Apr 26, 2024 • 4

LoneStriker/Llama-3-8B-Instruct-262k-5.0bpw-h6-exl2

Text Generation • Updated Apr 26, 2024 • 6

LoneStriker/Llama-3-8B-Instruct-262k-6.0bpw-h6-exl2

Text Generation • Updated Apr 26, 2024 • 4

LoneStriker/Llama-3-8B-Instruct-262k-8.0bpw-h8-exl2

Text Generation • Updated Apr 26, 2024 • 5

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_8.0bpw

Text Generation • Updated Apr 26, 2024 • 7 • 3

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_6.0bpw

Text Generation • Updated Apr 26, 2024 • 8

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_5.0bpw

Text Generation • Updated Apr 26, 2024 • 5

QuantFactory/Llama-3-8B-Instruct-262k-GGUF

Text Generation • Updated Apr 26, 2024 • 127

LiteLLMs/Llama-3-8B-Instruct-262k-GGUF

Text Generation • Updated Apr 29, 2024 • 49 • 1

blockblockblock/Llama-3-8B-Instruct-Gradient-1048k-bpw2.25-exl2

Text Generation • Updated May 9, 2024 • 10 • 1