Edit Models filters

Inference status

Misc

arxiv: 2310.05209

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

35

Full-text search

Active filters: 2310.05209

grimjim/cuckoo-starling-32k-7B

Text Generation • Updated May 23, 2024 • 27 • 3

gradientai/Llama-3-70B-Instruct-Gradient-262k

Text Generation • Updated Oct 28, 2024 • 87 • 55

gradientai/Llama-3-70B-Instruct-Gradient-524k

Text Generation • Updated Oct 28, 2024 • 67 • 23

gradientai/Llama-3-70B-Instruct-Gradient-1048k

Text Generation • Updated Oct 28, 2024 • 327 • 121

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-GGUF

Text Generation • Updated May 4, 2024 • 8 • 1

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-2.4bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 18

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-3.5bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 16

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-4.0bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 18 • 1

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-4.65bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 15

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-5.0bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 19

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-6.0bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 14

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-GGUF

Text Generation • Updated May 4, 2024 • 1 • 3

bullerwins/gradientai_Llama-3-70B-Instruct-Gradient-262k_exl2_8.0bpw

Text Generation • Updated May 4, 2024 • 14

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-2.4bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 14 • 1

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-3.5bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 15

cognitivecomputations/Llama-3-70B-Gradient-524k-adapter

Updated May 5, 2024 • 32

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-4.0bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 14

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-4.65bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 14

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-5.0bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 14

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-6.0bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 18

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-2.25bpw-h6-exl2

Text Generation • Updated May 6, 2024 • 16

vsevolodl/Llama-3-70B-Instruct-Gradient-1048k-GGUF

Text Generation • Updated May 10, 2024 • 123 • 3

starsy/Llama-3-70B-Instruct-Gradient-262k-AWQ

Text Generation • Updated May 17, 2024 • 28

starsy/Llama-3-70B-Instruct-Gradient-1048k-AWQ

Text Generation • Updated May 17, 2024 • 20 • 1

grimjim/cuckoo-starling-32k-7B-GGUF

Text Generation • Updated Aug 27, 2024 • 9 • 1

RichardErkhov/gradientai_-_Llama-3-70B-Instruct-Gradient-1048k-gguf

Updated May 29, 2024 • 102

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_8.0bpw

Text Generation • Updated Jun 6, 2024 • 21

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_7.5bpw

Text Generation • Updated Jun 6, 2024 • 19

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_7.0bpw

Text Generation • Updated Jun 6, 2024 • 19

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_6.5bpw

Text Generation • Updated Jun 7, 2024 • 22