PrunaAI/deepseek-ai-DeepSeek-R1-Distill-Qwen-7B-HQQ-4bit-smashed
Updated
•
6
Pruna AI
Enterprise
company
AI & ML interests
Efficient machine learning for any model and hardware: pruning, quantization, compilation, and more.
Recent Activity
PrunaAI's activity
Upload folder using huggingface_hub
2
#3 opened 3 days ago
by
sharpenb
sharpenb
updated
a
model
3 days ago
Upload folder using huggingface_hub
2
#4 opened 3 days ago
by
sharpenb
sharpenb
updated
a
model
3 days ago
Upload folder using huggingface_hub
2
#3 opened 3 days ago
by
sharpenb
sharpenb
updated
a
model
3 days ago
Upload folder using huggingface_hub
2
#7 opened 3 days ago
by
sharpenb
sharpenb
updated
a
model
3 days ago
Upload folder using huggingface_hub
2
#5 opened 3 days ago
by
sharpenb
sharpenb
updated
a
model
3 days ago
Upload folder using huggingface_hub
2
#5 opened 3 days ago
by
sharpenb
sharpenb
updated
a
model
3 days ago
Upload folder using huggingface_hub
2
#4 opened 3 days ago
by
sharpenb
sharpenb
updated
a
model
3 days ago
Upload folder using huggingface_hub
2
#4 opened 3 days ago
by
sharpenb
sharpenb
updated
2
models
3 days ago
Post
496
How to deploy compressed ML models in your pipeline?
We wrote a series of blogs on this topics. Hope that it can be helpful to people:
- Standard Model Compression in ML Pipeline: https://www.pruna.ai/blog/standard-model-compression-ml-pipeline
- Boost Your Replicate Models with Pruna AI: A Step-by-Step Guide: https://www.pruna.ai/blog/guide-replicate-pruna-ai
- Pruna + Triton: A Winning Combination for High-Performance AI Deployments: https://www.pruna.ai/blog/pruna-triton-combination
Feel free to join our discord (https://discord.com/invite/rskEr4BZJx) if you have questions ;)
We wrote a series of blogs on this topics. Hope that it can be helpful to people:
- Standard Model Compression in ML Pipeline: https://www.pruna.ai/blog/standard-model-compression-ml-pipeline
- Boost Your Replicate Models with Pruna AI: A Step-by-Step Guide: https://www.pruna.ai/blog/guide-replicate-pruna-ai
- Pruna + Triton: A Winning Combination for High-Performance AI Deployments: https://www.pruna.ai/blog/pruna-triton-combination
Feel free to join our discord (https://discord.com/invite/rskEr4BZJx) if you have questions ;)
Post
1881
We compressed SmolLMs to make 135 variations of them (see https://huggingface.co/PrunaAI?search_models=smolLM) with different quantization configurations with
We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
pruna (https://docs.pruna.ai/en/latest/). We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
-
- 3 replies