
Edit Models filters
Apps
Inference Providers
Active filters:
llama-cpp

miha-kac/RAFT-mistral-v1-merged-Q4_K_M-GGUF
7B•
Updated
•
10

nvhf/propositionizer-wiki-flan-t5-large-Q6_K-GGUF
0.8B•
Updated
•
13

kingabzpro/Gemma-2-9b-it-chat-doctor-Q4_K_M-GGUF
9B•
Updated
•
4

SkyNotion/Phi-3-mini-128k-instruct-Q2_K-GGUF
•
4B•
Updated
•
7
Text Generation

SkyNotion/TinyLlama_v1.1-Q2_K-GGUF
1B•
Updated
•
7
exocet25/gemma-2-9b-Q4_K_M-GGUF
•
9B•
Updated
•
1
Text Generation

gsayak/Phi-3-mini-4k-instruct-Q8_0-GGUF
•
4B•
Updated
•
9
Text Generation

alanrios2001/Phi-3-mini-4k-instruct-Q5_K_M-GGUF
•
4B•
Updated
•
5
Text Generation
plehrman24/Meta-Llama-3-8B-Q5_K_M-GGUF
•
8B•
Updated
•
3
Text Generation
MegaTom/deepseek-coder-1.3b-instruct-Q4_K_M-GGUF
1B•
Updated
•
96
mbahrsnc/llama3-8b-enhanced-IQ3_M-GGUF
8B•
Updated
•
8
nightcatsong/DeepSeek-V2-Lite-Chat-Q8_0-GGUF
16B•
Updated
•
5
JongRok/llama-3-Korean-Bllossom-8B-Q2_K-GGUF
8B•
Updated
•
4
CoolSpring/Qwen2-0.5B-Abyme-Q8_0-GGUF
0.5B•
Updated
•
7
cleatherbury/gte-Qwen2-7B-instruct-Q5_K_M-GGUF
•
8B•
Updated
Sentence Similarity
martintomov/gemma-2-9b-Q4_K_M-GGUF
•
9B•
Updated
•
6
Text Generation
martintomov/h2o-danube-1.8b-chat-Q8_0-GGUF
•
2B•
Updated
•
5
Text Generation
martintomov/h2o-danube3-4b-chat-Q8_0-GGUF
•
4B•
Updated
•
5
Text Generation
martintomov/h2o-danube3-4b-base-Q8_0-GGUF
•
4B•
Updated
•
1
Text Generation

MugenYume/Phi-3-mini-4k-instruct-IQ4_NL-GGUF
•
4B•
Updated
•
11
Text Generation

MugenYume/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
•
4B•
Updated
•
4
Text Generation

MugenYume/Phi-3-mini-4k-instruct-Q5_K_M-GGUF
•
4B•
Updated
•
5
Text Generation

alanrios2001/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF
•
8B•
Updated
•
3
Text Generation

alanrios2001/Meta-Llama-3-8B-Q4_K_M-GGUF
•
8B•
Updated
•
1
Text Generation

hpcgroup/hpc-coder-v2-6.7b-Q8_0-GGUF
7B•
Updated
•
17
•
1

hpcgroup/hpc-coder-v2-6.7b-Q4_K_S-GGUF
7B•
Updated
•
9
•
1

aifeifei798/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
•
4B•
Updated
•
10
Text Generation

aifeifei798/Phi-3-mini-4k-instruct-IQ4_NL-GGUF
•
4B•
Updated
•
2
Text Generation
jdumanski/gpt2-Q4_K_M-GGUF
0.2B•
Updated
•
9