NVOM.ai LLama 3.2 3b (GGUF)
A lightweight model optimized and trained on 100k+ dataset by nvom.ai
Benchmarks
NVOM.ai AIBench SmartBench Specials (Based on NVOM.ai bench)
NVOM Preview 4b 7.91 10.12 9.49 Speed, Smart, Quanatisation 8-12 - best
NVOM LLama 3.2 3b 6.11 4.95 3.31 Speed, Quanatisation 5-8 - normal
Meta LLama 3.2 3b 3.76 2.11 2.93 Quanatisation 1-4 - bad
Run model locally
You can use LM STUDIO to start model Or you can use code and Transformers
Soon more information
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.