-
second-state/stable-diffusion-v1-5-GGUF
Text-to-Image • Updated • 860 • 7 -
second-state/stable-diffusion-v-1-4-GGUF
Text-to-Image • Updated • 413 • 3 -
second-state/stable-diffusion-3.5-medium-GGUF
Text-to-Image • Updated • 1.01k • 5 -
second-state/stable-diffusion-3.5-large-GGUF
Text-to-Image • Updated • 686 • 1
AI & ML interests
Run open source LLMs across CPU and GPU without changing the binary in Rust and Wasm locally!
Recent Activity
View all activity
Organization Card
Run Open source LLMs and create OpenAI-compatible API services for the Llama2 series of LLMs locally With LlamaEdge!
Give it a try
Run a single command in your command line terminal.
bash <(curl -sSfL 'https://raw.githubusercontent.com/LlamaEdge/LlamaEdge/main/run-llm.sh') --interactive
Follow the on-screen instructions to install the WasmEdge Runtime and download your favorite open-source LLM. Then, choose whether you want to chat with the model via the CLI or via a web UI.
See it in action | GitHub | Docs
Why?
LlamaEdge, powered by Rust and WasmEdge, provides a strong alternative to Python in AI inference.
- Lightweight. The total runtime size is 30MB.
- Fast. Full native speed on GPUs.
- Portable. Single cross-platform binary on different CPUs, GPUs, and OSes.
- Secure. Sandboxed and isolated execution on untrusted devices.
- Container-ready. Supported in Docker, containerd, Podman, and Kubernetes.
Learn more
Please visit the LlamaEdge project to learn more.
Collections
10
LlamaEdge compatible quants for Falcon3-Instruct models.
-
second-state/Falcon3-10B-Instruct-GGUF
Text Generation • Updated • 292 -
second-state/Falcon3-7B-Instruct-GGUF
Text Generation • Updated • 352 • 1 -
second-state/Falcon3-3B-Instruct-GGUF
Text Generation • Updated • 197 -
second-state/Falcon3-1B-Instruct-GGUF
Text Generation • Updated • 71
models
213
second-state/Phi-3.5-MoE-instruct-GGUF
Text Generation
•
Updated
•
122
second-state/Falcon3-1B-Instruct-GGUF
Text Generation
•
Updated
•
71
second-state/Falcon3-3B-Instruct-GGUF
Text Generation
•
Updated
•
197
second-state/Falcon3-7B-Instruct-GGUF
Text Generation
•
Updated
•
352
•
1
second-state/Falcon3-10B-Instruct-GGUF
Text Generation
•
Updated
•
292
second-state/Qwen2-VL-72B-Instruct-GGUF
Image-Text-to-Text
•
Updated
•
418
second-state/Qwen2-VL-2B-Instruct-GGUF
Image-Text-to-Text
•
Updated
•
452
•
1
second-state/Qwen2-VL-7B-Instruct-GGUF
Image-Text-to-Text
•
Updated
•
711
•
1
second-state/Megrez-3B-Instruct-GGUF
Text Generation
•
Updated
•
299
•
1
second-state/phi-4-GGUF
Text Generation
•
Updated
•
213
datasets
None public yet