Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

18,415

Full-text search

Active filters: bitsandbytes

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/allenai-tulu-2-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 13

PrunaAI/Intel-neural-chat-7b-v3-2-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 11

PrunaAI/deepseek-ai-deepseek-math-7b-base-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

JFernandoGRE/mistral_7b_augmenteddemocracy_dups_all4_age

Text Generation • Updated Apr 7, 2024 • 14

PrunaAI/allenai-tulu-2-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

PrunaAI/Intel-neural-chat-7b-v3-2-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/deepseek-ai-deepseek-math-7b-base-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/jphme-em_german_leo_mistral-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 11

JFernandoGRE/mistral_7b_augmenteddemocracy_dups_all4_zone

Text Generation • Updated Apr 7, 2024 • 8

PrunaAI/Locutusque-TinyMistral-248M-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

PrunaAI/Locutusque-TinyMistral-248M-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

unsloth/gemma-1.1-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.43k • 4

unsloth/gemma-1.1-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 327 • 2

PrunaAI/PygmalionAI-pygmalion-2-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 11

PrunaAI/KnutJaegersberg-Qwen-1_8B-Llamafied-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

jkukul/gemma-fine-tuned-merged

Text Generation • Updated Apr 7, 2024 • 8

PrunaAI/22h-open-cabrita3b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/Unbabel-TowerBase-7B-v0.1-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 15

PrunaAI/beomi-Yi-Ko-6B-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

PrunaAI/haoranxu-ALMA-7B-Pretrain-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/Unbabel-TowerBase-7B-v0.1-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/PygmalionAI-pygmalion-2-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/22h-open-cabrita3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

PrunaAI/beomi-Yi-Ko-6B-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

Pennlaine/Mistral-7B-v0.1-entity-extraction

Text Generation • Updated Apr 24, 2024

unsloth/Hermes-2-Pro-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 7

unsloth/Starling-LM-7B-beta-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 8

unsloth/OpenHermes-2.5-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 76 • 1

Ryzhtus/mistral-7b-v0.1-function-calling-chatml-v3

Text Generation • Updated Apr 7, 2024 • 6