Edit Models filters

Inference status

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

7,586

Full-text search

Active filters: pruna-ai

PrunaAI/numind-NuExtract-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 18

PrunaAI/numind-NuExtract-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 13

PrunaAI/numind-NuExtract-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 13

PrunaAI/numind-NuExtract-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 18

PrunaAI/numind-NuExtract-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 21

PrunaAI/numind-NuExtract-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 13

PrunaAI/nlpai-lab-KULLM3-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 14

PrunaAI/nlpai-lab-KULLM3-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 14

PrunaAI/nlpai-lab-KULLM3-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 15

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 18

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-bnb-8bit-smashed

Text Generation • Updated Jul 16, 2024 • 20

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 18

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 18

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 17

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 13

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 21

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 16

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 17

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 12

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 12

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 13

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 24

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 20

PrunaAI/aari1995-germeo-7b-laser-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 13

PrunaAI/aari1995-germeo-7b-laser-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 14

PrunaAI/aari1995-germeo-7b-laser-bnb-8bit-smashed

Text Generation • Updated Jul 16, 2024 • 18

PrunaAI/aari1995-germeo-7b-laser-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 13

PrunaAI/aari1995-germeo-7b-laser-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 20

PrunaAI/aari1995-germeo-7b-laser-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 17

PrunaAI/chujiezheng-Llama-3-Instruct-8B-SimPO-ExPO-GGUF-smashed

Updated Jul 16, 2024 • 20