t1u1's picture

t1u1

t1u1

·

AI & ML interests

None yet

Recent Activity

reacted to mitkox's post with 👍 about 7 hours ago

llama.cpp is 26.8% faster than ollama. I have upgraded both, and using the same settings, I am running the same DeepSeek R1 Distill 1.5B on the same hardware. It's an Apples to Apples comparison. Total duration: llama.cpp 6.85 sec <- 26.8% faster ollama 8.69 sec Breakdown by phase: Model loading llama.cpp 241 ms <- 2x faster ollama 553 ms Prompt processing llama.cpp 416.04 tokens/s with an eval time 45.67 ms <- 10x faster ollama 42.17 tokens/s with an eval time of 498 ms Token generation llama.cpp 137.79 tokens/s with an eval time 6.62 sec <- 13% faster ollama 122.07 tokens/s with an eval time 7.64 sec llama.cpp is LLM inference in C/C++; ollama adds abstraction layers and marketing. Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

reacted to lewtun's post with 🚀 about 7 hours ago

We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open! 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1. 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code. 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training. Follow along: https://github.com/huggingface/open-r1

liked a model about 9 hours ago

mkurman/Qwen2.5-14B-DeepSeek-R1-1M

View all activity

Organizations

None yet

t1u1's activity

New activity in unsloth/phi-4-GGUF 6 days ago

Can you please create weighted/imatrix quant versions?

#1 opened 6 days ago by

New activity in m-a-p/MusicPile 11 months ago

Auto conversion from MIDI to ABC

#2 opened 11 months ago by

New activity in musiclang/musiclang-predict 11 months ago

Short duration

#1 opened 11 months ago by

New activity in m-a-p/ChatMusician 11 months ago

Small bugs in the dataset

#4 opened 11 months ago by

New activity in MaziyarPanahi/ChatMusician-GGUF 11 months ago

Enable text inference

#2 opened 11 months ago by

New activity in m-a-p/ChatMusician 11 months ago

Quantized version

#2 opened 11 months ago by