Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

8,902

Full-text search

Active filters: pruna-ai

PrunaAI/Open-Orca-Mistral-7B-SlimOrca-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/Cheng98-llama-160m-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/AI-Sweden-Models-gpt-sw3-126m-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/AI-Sweden-Models-gpt-sw3-126m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/Cheng98-llama-160m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/dbmdz-german-gpt2-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/OpenBuddy-openbuddy-openllama-7b-v12-bf16-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/princeton-nlp-Sheared-LLaMA-2.7B-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 12

PrunaAI/robowaifudev-megatron-gpt2-345m-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/meta-math-MetaMath-Mistral-7B-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/robowaifudev-megatron-gpt2-345m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/NousResearch-Yarn-Mistral-7b-64k-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/facebook-xglm-7.5B-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/bigscience-bloomz-7b1-mt-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/princeton-nlp-Sheared-LLaMA-2.7B-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/facebook-xglm-7.5B-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/uukuguy-speechless-code-mistral-7b-v1.0-bnb-4bit-smashed

Updated Aug 2, 2024 • 6

PrunaAI/beomi-open-llama-2-ko-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/FlagAlpha-Llama2-Chinese-7b-Chat-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/KnutJaegersberg-Qwen-1_8B-Llamafied-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/meta-math-MetaMath-Mistral-7B-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/lvwerra-gpt2-imdb-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/lvwerra-gpt2-imdb-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/OpenAssistant-falcon-7b-sft-top1-696-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 14

PrunaAI/lgaalves-gpt2-dolly-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/lgaalves-gpt2-dolly-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/OpenAssistant-falcon-7b-sft-mix-2000-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

PrunaAI/OpenAssistant-falcon-7b-sft-mix-2000-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 12

PrunaAI/qqlabs-llama2_esci_v1-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/beomi-open-llama-2-ko-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5