File size: 1,051 Bytes
c3d28e6
 
0f34e54
c3d28e6
0f34e54
c3d28e6
 
 
 
5a9070c
 
0f34e54
 
2185e14
04e2b6d
0f34e54
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
title: README
emoji: 💻
colorFrom: purple
colorTo: blue
sdk: static
pinned: false
---

# Software-delivered AI Inference

Neural Magic helps developers in accelerating deep learning performance using automated model sparsification technologies and a CPU inference engine.

Download and run our sparsity-aware inference engine and open source tools for GPU-class performance on CPUs.

* [DeepSparse](https://github.com/neuralmagic/deepsparse): Inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application

* [SparseML](https://github.com/neuralmagic/sparseml): Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

* [SparseZoo](https://sparsezoo.neuralmagic.com/): Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes


<img src="https://cdn-uploads.huggingface.co/production/uploads/60466e4b4f40b01b66151416/BrYG-6c74fnlWFxR3LvqT.png" alt="sparsezoo" width="500"/>