Edit Models filters

Inference status

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

7,604

Full-text search

Active filters: pruna-ai

PrunaAI/amazon-MistralLite-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/microsoft-phi-1_5-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/tiiuae-falcon-rw-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/codellama-CodeLlama-7b-Instruct-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/teknium-OpenHermes-2.5-Mistral-7B-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/Open-Orca-Mistral-7B-OpenOrca-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/cahya-gpt2-small-indonesian-522M-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/facebook-opt-iml-1.3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/nomic-ai-gpt4all-falcon-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 53

PrunaAI/codellama-CodeLlama-7b-Instruct-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/HuggingFaceH4-zephyr-7b-alpha-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/princeton-nlp-Sheared-LLaMA-1.3B-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/fxmarty-really-tiny-falcon-testing-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/fxmarty-really-tiny-falcon-testing-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/NousResearch-Yarn-Mistral-7b-128k-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/Open-Orca-Mistral-7B-OpenOrca-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/JackFram-llama-160m-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/cahya-gpt2-small-indonesian-522M-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/princeton-nlp-Sheared-LLaMA-1.3B-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/JackFram-llama-160m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/NousResearch-Yarn-Mistral-7b-128k-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10

PrunaAI/togethercomputer-LLaMA-2-7B-32K-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/Arotte-gpt2-small-mt-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/cognitivecomputations-dolphin-2.2.1-mistral-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 16 • 1

PrunaAI/elyza-ELYZA-japanese-Llama-2-7b-instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/togethercomputer-GPT-JT-6B-v1-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 170 • 1

PrunaAI/Arotte-gpt2-small-mt-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 12

PrunaAI/cognitivecomputations-dolphin-2.1-mistral-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/togethercomputer-LLaMA-2-7B-32K-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/cognitivecomputations-dolphin-2.6-mistral-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7