7 9 44

Mitko Vasilev

mitkox

AI & ML interests

Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

Recent Activity

posted an update about 8 hours ago

I run Qwen3-Coder 480B locally on my Z8, with a 1-million token context window. It’s the equivalent of parallel-parking a Nimitz-class carrier in a kiddie pool. Thanks to whatever dark pact the llama.cpp, CUDA, and kernel folks signed, hybrid inferencing + VRAM↔RAM offload let me stream the model’s synapses across Xeon, RAM, and four lonely A6000s without summoning either the OOM killer or a small house fire.

posted an update 6 days ago

I needed a distraction-free AI dev system. Omarchy-AI is an opinionated, minimalist, purpose-built OS layer for AI engineers. Arch Linux, stripped, hardened, and injected with pure, uncut AI developer ergonomics. TL;DR Omarchy-AI. Vertical AF. One Job, Done Stupidly Well. Only cares about AI engineering. It’s built on top of Arch Linux & Omarchy and further optimized for: - Offline, on-the-go AI development. Yes, even on your gaming laptop, or freshly minted DIGITS - Seamless shift to GPU server backends, because your PC shouldn’t train a 1T Kimi K2 model - Pre-baked RAG pipelines, agentic workflows, and model fine-tuning - Actual productivity to spend hours hacking local AI agents, not debugging uv conflicts. How It Works (The Geeky Bits) It’s One Curl Command to Rule Them All. Turning a vanilla Arch into a batteries-included local AI dev beast with Hyprland, CUDA, llama.cpp, gcc, and every CLI tool you pretend to know about. Hyprland: Because Your GPU Deserves Glam Shots. Picked it for the nihilists, tweakers, and keyboard cowboys. It’s an independent Wayland compositor that works great and has zero questions like “how do I get this pretty?” Make sure you own your AI. AI in the cloud is not aligned with you; it’s aligned with the company that owns it.

liked a model 13 days ago

moonshotai/Kimi-K2-Instruct

View all activity

Organizations

Posts 13

Post

116

Post

194

I needed a distraction-free AI dev system. Omarchy-AI is an opinionated, minimalist, purpose-built OS layer for AI engineers. Arch Linux, stripped, hardened, and injected with pure, uncut AI developer ergonomics.

TL;DR Omarchy-AI. Vertical AF. One Job, Done Stupidly Well. Only cares about AI engineering.

It’s built on top of Arch Linux & Omarchy and further optimized for:
- Offline, on-the-go AI development. Yes, even on your gaming laptop, or freshly minted DIGITS
- Seamless shift to GPU server backends, because your PC shouldn’t train a 1T Kimi K2 model
- Pre-baked RAG pipelines, agentic workflows, and model fine-tuning
- Actual productivity to spend hours hacking local AI agents, not debugging uv conflicts.

How It Works (The Geeky Bits)
It’s One Curl Command to Rule Them All. Turning a vanilla Arch into a batteries-included local AI dev beast with Hyprland, CUDA, llama.cpp, gcc, and every CLI tool you pretend to know about.

Hyprland: Because Your GPU Deserves Glam Shots. Picked it for the nihilists, tweakers, and keyboard cowboys. It’s an independent Wayland compositor that works great and has zero questions like “how do I get this pretty?”

Make sure you own your AI. AI in the cloud is not aligned with you; it’s aligned with the company that owns it.

View all Posts