Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

14,875

Full-text search

Active filters: bitsandbytes

PrunaAI/sakaltcommunity-sakaltum-7b-bnb-8bit-smashed

Updated 12 days ago • 5 • 1

PrunaAI/sakaltcommunity-wasser-4b-bnb-8bit-smashed

Updated 12 days ago • 6 • 1

PrunaAI/EpistemeAI-Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic-bnb-8bit-smashed

Updated 12 days ago • 7 • 1

vitekkor/T-pro-it-1.0-bnb-8bit

Updated 9 days ago • 572 • 1

Aixr/LLama-3.1-Thinkable

Updated 8 days ago • 11 • 1

PrunaAI/Sakalti-Saba1-3B-bnb-8bit-smashed

Updated 10 days ago • 5 • 1

prithivMLmods/QwQ-4B-Instruct

Text Generation • Updated 9 days ago • 227 • 8

Pedro13543/Nice_mix_LoRa

Text Generation • Updated 9 days ago • 12 • 1

PrunaAI/Pinkstack-PARM-V2-QwQ-Qwen-2.5-o1-3B-VLLM-bnb-8bit-smashed

Updated 9 days ago • 14 • 1

JigmeNgodup/DISC-LawLLM-Int8

Updated 4 days ago • 44 • 1

aboots/gemma2-mixed-therapy-ft

Text Generation • Updated 6 days ago • 67 • 1

sohail-shaikh-s07/llama-2-7b-test-ava

Text Generation • Updated 5 days ago • 32 • 1

PrunaAI/romanoza-gpt2-small-III-bnb-8bit-smashed

Updated 4 days ago • 4 • 1

PrunaAI/Sakalti-saba1.5-coder-bnb-8bit-smashed

Updated 3 days ago • 1

aadi8anant/lora_model

Text Generation • Updated 1 day ago • 7 • 1

seungillee/mistral-7b-qlora-16-32arc-cot-merged

Text Generation • Updated 1 day ago • 11 • 1

mjschock/SmolVLM-Instruct

Image-Text-to-Text • Updated about 20 hours ago • 12 • 1

DeL-TaiseiOzaki/llm-jp-3-172b-instruct3-4bit

Text Generation • Updated about 12 hours ago • 1

kaifkhaan/Roast_Bot

Text Generation • Updated Sep 22 • 24 • 1

Triangle104/lemonilia_ShoriRP-v0.75d

Text Generation • Updated 23 days ago • 2 • 1

Sakuna/LLaMaCoder

Text2Text Generation • Updated Jan 3 • 7 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • Updated Nov 19, 2023 • 15 • 3

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 25

Mediocreatmybest/instructblip-vicuna-13b_8bit

Image-Text-to-Text • Updated Nov 19, 2023 • 12

Mediocreatmybest/instructblip-flan-t5-xl_8bit

Image-to-Text • Updated Nov 20, 2023 • 12 • 1

Mediocreatmybest/instructblip-flan-t5-xxl_8bit

Image-to-Text • Updated Nov 20, 2023 • 11 • 1

nominate/llama2-13b-chat-hf-jmc-001-merged-q8_0

Text Generation • Updated Aug 11, 2023 • 29

jionlyu/3B-test

Text Generation • Updated Aug 16, 2023 • 14

rajuptvs/bigscience_bloom-560m_sharded_8bit

Text Generation • Updated Sep 27, 2023 • 24

rajuptvs/stabilityai_stablecode-instruct-alpha-3b-sharded-8bit

Text Generation • Updated Aug 16, 2023 • 14