-
-
-
-
-
-
Inference status
Active filters:
pruna-ai
PrunaAI/openai-community-gpt2-medium-bnb-4bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/tiiuae-falcon-rw-1b-bnb-4bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/EleutherAI-gpt-neo-125m-bnb-4bit-smashed
Text Generation
•
Updated
•
13
PrunaAI/KoboldAI-OPT-6.7B-Nerybus-Mix-bnb-8bit-smashed
Text Generation
•
Updated
•
15
PrunaAI/openai-community-gpt2-large-bnb-8bit-smashed
Text Generation
•
Updated
•
9
PrunaAI/EleutherAI-gpt-neo-125m-bnb-8bit-smashed
Text Generation
•
Updated
•
9
PrunaAI/h2oai-h2ogpt-4096-llama2-7b-chat-bnb-4bit-smashed
Text Generation
•
Updated
•
16
PrunaAI/mistralai-Mistral-7B-v0.1-bnb-8bit-smashed
Text Generation
•
Updated
•
12
PrunaAI/openai-community-gpt2-medium-bnb-8bit-smashed
Text Generation
•
Updated
•
13
PrunaAI/tiiuae-falcon-7b-instruct-bnb-4bit-smashed
Text Generation
•
Updated
•
14
PrunaAI/h2oai-h2ogpt-4096-llama2-7b-chat-bnb-8bit-smashed
Text Generation
•
Updated
•
18
PrunaAI/amazon-MistralLite-bnb-4bit-smashed
Text Generation
•
Updated
•
12
PrunaAI/mistralai-Mistral-7B-Instruct-v0.1-bnb-8bit-smashed
Text Generation
•
Updated
•
9
PrunaAI/NousResearch-Llama-2-7b-chat-hf-bnb-4bit-smashed
Text Generation
•
Updated
•
11
PrunaAI/mistralai-Mistral-7B-Instruct-v0.2-bnb-8bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/tiiuae-falcon-rw-1b-bnb-8bit-smashed
Text Generation
•
Updated
•
11
PrunaAI/tiiuae-falcon-7b-instruct-bnb-8bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/openai-community-gpt2-xl-bnb-4bit-smashed
Text Generation
•
Updated
•
12
PrunaAI/HuggingFaceH4-zephyr-7b-beta-bnb-8bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/openai-community-gpt2-xl-bnb-8bit-smashed
Text Generation
•
Updated
•
13
PrunaAI/teknium-OpenHermes-2-Mistral-7B-bnb-4bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/fxmarty-tiny-llama-fast-tokenizer-bnb-8bit-smashed
Text Generation
•
Updated
•
11
PrunaAI/codellama-CodeLlama-7b-hf-bnb-4bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/tiiuae-falcon-7b-bnb-4bit-smashed
Text Generation
•
Updated
•
12
PrunaAI/NousResearch-Llama-2-7b-chat-hf-bnb-8bit-smashed
Text Generation
•
Updated
•
9
PrunaAI/teknium-OpenHermes-2.5-Mistral-7B-bnb-4bit-smashed
Text Generation
•
Updated
•
9
PrunaAI/JackFram-llama-68m-bnb-4bit-smashed
Text Generation
•
Updated
•
14
PrunaAI/JackFram-llama-68m-bnb-8bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/trl-internal-testing-dummy-GPT2-correct-vocab-bnb-4bit-smashed
Text Generation
•
Updated
•
10
PrunaAI/EleutherAI-gpt-neo-2.7B-bnb-4bit-smashed
Text Generation
•
Updated
•
10