Edit Models filters

Inference status

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

7,586

Full-text search

Active filters: pruna-ai

PrunaAI/JackFram-llama-160m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/NousResearch-Yarn-Mistral-7b-128k-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/togethercomputer-LLaMA-2-7B-32K-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 14

PrunaAI/Arotte-gpt2-small-mt-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/cognitivecomputations-dolphin-2.2.1-mistral-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 12 • 1

PrunaAI/elyza-ELYZA-japanese-Llama-2-7b-instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/togethercomputer-GPT-JT-6B-v1-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 158 • 1

PrunaAI/Arotte-gpt2-small-mt-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 14

PrunaAI/cognitivecomputations-dolphin-2.1-mistral-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

PrunaAI/togethercomputer-LLaMA-2-7B-32K-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 11

PrunaAI/cognitivecomputations-dolphin-2.6-mistral-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

PrunaAI/TinyPixel-Llama-2-7B-bf16-sharded-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/elyza-ELYZA-japanese-Llama-2-7b-instruct-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 12

PrunaAI/Salesforce-codegen-350M-nl-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 14

PrunaAI/cognitivecomputations-dolphin-2.2.1-mistral-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/Salesforce-codegen-350M-nl-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/facebook-xglm-564M-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/togethercomputer-Llama-2-7B-32K-Instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/HuggingFaceH4-mistral-7b-sft-beta-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/beomi-llama-2-ko-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/cognitivecomputations-dolphin-2.1-mistral-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 9

PrunaAI/togethercomputer-GPT-JT-6B-v1-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 11 • 1

PrunaAI/TinyPixel-Llama-2-7B-bf16-sharded-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 11

PrunaAI/openai-community-openai-gpt-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/facebook-xglm-564M-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 13

PrunaAI/microsoft-phi-1-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 12

PrunaAI/GroNLP-gpt2-small-italian-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 18

PrunaAI/GroNLP-gpt2-small-italian-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 12

PrunaAI/Locutusque-gpt2-xl-conversational-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 11

PrunaAI/NousResearch-Yarn-Llama-2-7b-128k-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 12