Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-embeddings-inference

Misc with no match

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Models

52

Full-text search

Active filters: deepsparse

nm-testing/AmberChat-pruned50-quant-ds

Text Generation • Updated Dec 15, 2023 • 13

nm-testing/MiniChat-1.5-3B-pruned70-quant-ds

Text Generation • Updated Dec 19, 2023 • 17

neuralmagic/SOLAR-10.7B-Instruct-v1.0-pruned50-quant-ds

Text Generation • Updated Dec 20, 2023 • 17 • 5

nm-testing/mistral-7b-dpo-merge-v1.1-pruned50-quant-ds

Text Generation • Updated Jan 19 • 12

neuralmagic/CLIP-ViT-B-32-256x256-DataComp-s34B-b86K-quant-ds

Zero-Shot Classification • Updated Jan 12 • 8

neuralmagic/Nous-Hermes-llama-2-7b-pruned50-quant-ds

Text Generation • Updated Dec 20, 2023 • 15

nm-testing/Llama-2-7b-hf-pruned50-quant-ds

Text Generation • Updated Dec 20, 2023 • 15

neuralmagic/Llama2-7b-chat-pruned50-quant-ds

Text Generation • Updated Jan 10 • 22 • 9

neuralmagic/CLIP-ViT-B-32-256x256-DataComp-s34B-b86K-ds

Zero-Shot Classification • Updated Dec 20, 2023

nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned50-quant-ds

Text Generation • Updated Jan 4 • 12

neuralmagic/Nous-Hermes-2-SOLAR-10.7B-pruned50-quant-ds

Text Generation • Updated Jan 10 • 13 • 7

nm-testing/llama2-7b-gsm8k-pt-pruned50-quant-ds

Text Generation • Updated Feb 2 • 22

neuralmagic/Llama-2-7b-ultrachat200k-pruned_50-quantized-deepsparse

Text Generation • Updated May 7 • 13

neuralmagic/Llama-2-7b-ultrachat200k-pruned_70-quantized-deepsparse

Text Generation • Updated May 15 • 31

neuralmagic/Llama-2-7b-evol-code-alpaca-pruned_50-quantized-deepsparse

Text Generation • Updated May 15 • 12

neuralmagic/Llama-2-7b-evol-code-alpaca-pruned_70-quantized-deepsparse

Text Generation • Updated May 15 • 16

neuralmagic/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse

Text Generation • Updated May 16 • 18

neuralmagic/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse

Text Generation • Updated May 16 • 18 • 1

nm-testing/granite-7b-lab-pruned50-quant-ds

Text Generation • Updated May 1 • 15

mgoin/Meta-Llama-3-8B-Instruct-pruned50-quant-ds

Text Generation • Updated Jun 28 • 37

nm-testing/mobilenet_v1-1.0_pytorch_sparseml_imagenet_pruned-moderate

nm-testing/yolov8-m_pytorch_ultralytics_voc_pruned80_quant-none