Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

35,299

Full-text search

Active filters: bitsandbytes

PrunaAI/01-ai-Yi-6B-200K-bnb-8bit-smashed

Text Generation • Updated 24 days ago • 15

PrunaAI/WizardLM-WizardMath-7B-V1.0-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 21

PrunaAI/Intel-neural-chat-7b-v3-3-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/facebook-galactica-125m-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/facebook-galactica-125m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 16

PrunaAI/migtissera-Tess-XS-v1-3-yarn-128K-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 11

zhaospei/quant-hinny-coder-6.7b-java

Text Generation • Updated Apr 6, 2024 • 6

PrunaAI/WizardLM-WizardCoder-3B-V1.0-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 13

PrunaAI/WizardLM-WizardMath-7B-V1.0-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/facebook-galactica-1.3b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 12

hrangel/MistralFineTuningSQL2

Text Generation • Updated Apr 6, 2024 • 4

PrunaAI/WizardLM-WizardCoder-3B-V1.0-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 24

PrunaAI/Intel-neural-chat-7b-v3-3-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/cerebras-Cerebras-GPT-590M-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/elyza-ELYZA-japanese-Llama-2-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

hinny-coder/quant-hinny-coder-6.7b-java

Text Generation • Updated Apr 7, 2024 • 4

PrunaAI/facebook-galactica-1.3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 14

PrunaAI/cerebras-Cerebras-GPT-590M-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 13 • 1

PrunaAI/norallm-normistral-7b-warm-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/norallm-normistral-7b-warm-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 13

PrunaAI/MBZUAI-LaMini-GPT-124M-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/42dot-42dot_LLM-PLM-1.3B-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/MBZUAI-LaMini-GPT-124M-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/cerebras-Cerebras-GPT-111M-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/42dot-42dot_LLM-PLM-1.3B-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/cactusfriend-nightmare-promptgen-XL-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/euclaise-Ferret_7B-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/cactusfriend-nightmare-promptgen-XL-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

JFernandoGRE/mistral_7b_augmenteddemocracy_dups_all4_ideology

Text Generation • Updated Apr 6, 2024 • 4

PrunaAI/llm-agents-tora-code-7b-v1.0-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 6